Hearing assistance systems configured to detect and provide protection to the user from harmful conditions

ABSTRACT

The present universal wearable computing device relates to a hearing assistance system, device, method, and apparatus that provide a discreet approach to user hearing assistance, without relying on a conventional hearing aid. The hearing assistance system and the requisite electronics may be incorporated into frames that also function as eyeglasses with earphone(s) that may be connected to the frame to assist user hearing. An earphone may be configured with minimal electronics, such that a power source enable sound transmissions to the ear, is provided by a connection to the frame of the eyeglasses. In another example, the earphone is configured without any electronics and sound is transmitted to the user/listener&#39;s ear(s) via a psychoacoustic system. The sound quality of the transmissions to the earphones may be optimized using a tuning/equalizer application operating from a computing device, such as an app on a mobile device. The tuning/equalizer application can be used by the user/listener to optimize volume input levels to the earphone(s). The hearing assistance system may also protect from damaging environmental noise, provide heightened hearing capabilities, collect and process physiological and physical measurements, and provide communication capabilities for interacting with other computing devices.

RELATED APPLICATIONS

This application is a continuation-in-part of U.S. patent applicationSer. No. 14/597,045, filed Jan. 14, 2015, which claims the benefit ofU.S. Provisional Application No. 62/023,797, filed on Jul. 11, 2014 andU.S. Provisional Application No. 61/928,958, filed on Jan. 17, 2014. Theentire teachings of the above applications are incorporated herein byreference.

BACKGROUND

Standard hearing aids include behind-the-ear (BTE), mini-BTE, andreceiver-in-the-canal (RIC) devices. Such hearing assistance devicestypically include sophisticated electronics to ensure the sound quality.Often, the designs of in-ear or behind-the-ear hearing assistancedevices are limited by the space available at human ears.

Hearing aids, for example, may include sophisticated electronics forsuppressing environmental noise and amplifying the speech signal.Moreover, hearing aids may have different styles such as in-canal andinside the outer ear. The limited physical spaces inside the canals orthe outer ear of human subject limit the size of circuits that may bedeployed in hearing aids. Furthermore, hearing aids do not have theability to place the microphone or microphone array any appreciabledistance from the ear. In addition, the shapes of outer ears of humansubjects vary significantly. Therefore, the shape of the hearing aiddevice may require custom design and fit in accordance with the shape ofthe ear of the human subject. All of these factors may significantlyincrease the purchase cost and replacement cost of in-ear orbehind-the-ear hearing assistance devices, such as hearing aids.

SUMMARY

Although hearing assistive instruments exist, they are often costly andunsightly, while the sound quality is mediocre at best. The conventionalhearing aids typically have a conspicuous appearance and provide poorsound quality. The currently available hearing aids tend to be expensiveand fail to achieve a design that is capable of striking a balancebetween providing a discrete appearance and high technology. Whileusers/listeners want the most advanced hearing technology, they alsowant discrete hearing aids that are inexpensive and technologicallysophisticated.

Embodiments of the present invention include a universal wearablecomputing device (UWD) that can provide hearing assistance. Theuniversal wearable computing device may be configured as a hearingassistance system and apparatus that is implemented with a discreetappearance, while providing advanced sound quality. For example, thepresent hearing assistance invention and its requisite electronics maybe incorporated into frames that also function as eyeglasses or have theappearance of eyeglasses along with an earphone or ear bud to assistuser hearing.

In some embodiments, a hearing assistance device may include a frameconfigured to be worn on the head of a user. The frame may include abridge configured to be supported on the nose of the user. A firsttransducer may be coupled to the frame. The first transducer may includeat least two microphones configured to receive an audio signal includingspeech. The at least two microphones are positioned such that:

a first lag microphone is situated at or near a rear portion of a firstside of the frame; and

a second microphone is situated at or near a front portion of the frame;

a converter configured to convert and to amplify the audio signal to anamplified representation of the audio signal; and

a second transducer for emitting the amplified representation of theaudio signal to a first earphone coupled to a first ear of the user,where at least a portion of the first earphone is removably coupled toat least a portion of the frame, such that when the first earphone is incontact with the portion of the frame, the first earphone is configuredto emit the amplified representation of the audio signal.

In some embodiments, the system further includes a third transducer foremitting the amplified representation of the audio signal to a secondearphone coupled to a second ear of the user, where at least a portionof the second earphone is removably coupled to at least a portion of theframe, such that when the second earphone is in contact with the portionof the frame, the second earphone is configured to emit the amplifiedrepresentation of the audio signal.

In further embodiments, the first earphone is replaced by a first earbudattached to a first earclip coupled to the first ear of the user, whereat least a portion of the first earclip is removably coupled to at leasta portion of the frame, such that when the first earclip is in contactwith the portion of the frame, the first earclip is configured to emitthe amplified representation of the audio signal. The first earclip maybe attached to the frame by a cone-shaped or v-shaped connector, inwhich a male cone-shaped or v-shaped component on the top of the firstearclip may attach to a corresponding female cone-shaped or v-shapedhole component on the frames. In other embodiments, the first earbud maybe directly coupled to the frame, without use of the earclip.

In further embodiments, the second earphone is replaced by a secondearbud attached to a second earclip coupled to the second ear of theuser, where at least a portion of the second earclip is removablycoupled to at least a portion of the frame, such that when the secondearclip is in contact with the portion of the frame, the second earclipis configured to emit the amplified representation of the audio signal.The second earclip may also be attached to the frame by a cone-shaped orv-shaped connector, in which a male cone-shaped or v-shaped component onthe top of the second earclip may attach to a corresponding femalecone-shaped or v-shaped hole component on the frames. In otherembodiments, the second earbud may be directly coupled to the frame,without use of the earclip.

In some embodiments, the first and second microphones of the hearingassistance system are configured as directional microphones.

In some embodiments of the hearing assistance system, the amplifiedrepresentation of the audio signal is an electronic amplifiedrepresentation of the audio signal that is transmitted to the earphone.In other embodiments, the amplified representation of the audio signalis an acoustic amplified representation of the audio signal that istransmitted to the earphone.

In some embodiments, the hearing assistance system includes anaccelerometer that detects vibration, such as the user's own voice orbanging of the frames, and squelches the noise from the vibration fromthe amplified representation of the audio signal. The amplifiedrepresentation of the audio signal is then transmitted to the earphonewith the noise from the vibration at a lower volume.

In some embodiments, the frame of the system is coupled to a firsthollow tube, such that that the acoustic amplified representation of theaudio signal reverberates off of the inside walls of the first hollowtube. In embodiments, the first hollow tube is made from rubber. Inexample embodiments of the system, the first earphone is configured witha rubber hollow tube, such that the amplified representation of theaudio signal reverberates off of the inside walls of the rubber hollowtube. In other embodiments of the system, the first hollow tube isconnected to a set of metal tubes, wherein the acoustic amplifiedrepresentation of the audio signal is transmitted to first and to secondearphones, which are respectively coupled to the first and to the secondear of the user. In embodiments comprising earbuds that may be attachedto earclips, instead of earphones, the earclips (or earbuds if notattached to earclips) are similarly configured with the rubber hollowtube.

In some embodiments of the hearing assistance system, the first andsecond earphones (or earbuds that may be attached to earclips) are madeof soft rubber to create a seal that facilitates blocking outenvironmental noise.

In some embodiments of the hearing assistance system with two earphones(or the earbud that may be attached to an earclip), the amplifiedrepresentation of the audio signal is transmitted to the first earphoneconnected to the first ear, and a second earphone connected to thesecond ear, respectively through respective channels enabling the userto hear the amplified representation of the audio signal in stereo inthe first and second ears.

In some embodiments of the hearing assistance system with two earphones,the first earphone is configured with a stiff flexible plastic membranein a speaker that vibrates in response to the amplified representationof the audio signal transmitted via an electrical connection to theframe. In some embodiments, the system of the speaker underneath theflexible plastic membrane is a metal coil that is configured to becoupled to a magnet portion of the frame, such that when the metal coilportion of the first earphone makes electromagnetic contact with theportion of the frame, the metal coil is magnetized causing the flexibleplastic membrane of the first earphone to vibrate and thereby transmitthe amplified representation of the audio signal to the first earphonecoupled to the user's first ear.

In one example preferred embodiment, the earphone (or the earbud thatmay be attached to an earclip) connects to the frames via sealed tube,which provides a constant amount of air, and facilitates a pressure wavegoing through the tube to the earphone. At the end of the tube, is astiff, flexible, thin plastic membrane in the earphone that creates anair seal at the end. A sound sound/pressure wave transmitted from theglasses frame through the tube. The change in air pressure in the tubemoves the membrane. In this way, an active speaker transducer embeddedin the glasses transmits the wave through the tube to the earphone.

In embodiments of the hearing assistance system with two earphones (orthe earbud that may be attached to an earclip), the first earphone isconfigured with a stiff flexible plastic membrane of a thin material.Air sealed tubes facilitate transmission from the glasses frame to theearphone. There is no magnetic action on the membrane. The method ofconnecting the other end of the tube to the glasses is magnetic.

The hearing assistance system may contain a first earphone (or theearbud that may be attached to an earclip) that includes passivenoise-canceling padding and high-density foam to prevent ambient soundwaves from reaching the user's first ear. The system may contain a firstearphone that includes active noise-canceling to mask low-frequencysound waves of ambient noise to cancel unwanted sound.

In some embodiments of the hearing assistance system, the frame providesan electrical power source to the first and second earphones (or theearbud that may be attached to an earclip), which are batteryless. Insome embodiments, the earphones are batteryless. In embodiments, theframe provides the power source to the first earphone. In someembodiments, the frame further comprises a fastener that facilitates aninterlock and an electrical connection with a portion of the firstearphone, such that when the first earphone is fastened to the frame viathe fastener, the first earphone is electrically powered to receive anelectrical transmission of the amplified representation of the audiosignal. In some different embodiments, the fasteners may be cone-shaped,v-shaped, or barrel shaped. If electrical connection with the frame islost, the earphone may be without electrical power. In embodiments, theearphone is substantially free of electrical components.

In related embodiments, the second microphone of the device is situatedat a front portion of one side of the frame or at a ribbon microphone atthe bridge of the frame.

In some embodiments of the device, the first lag microphone and a secondmicrophone both are situated on the first side of the frame.

In some embodiments, the first transducer of the hearing assistancedevice further comprises a third microphone configured to receive anaudio signal of the speech of the user. In example embodiments, thethird microphone receives auditory instructions from the user that aretranslated into computer readable instructions, which direct one or morecomputer processors embedded in the frame to perform electronic tasks.

In example embodiments, the hearing assistance device further comprisesa first capacitive touch sensitive area to control a function of thedevice. When the user touches the first capacitive touch sensitive area,the device translates the touch into computer readable instructions,which direct one or more computer processors embedded in the frame toperform electronic tasks. In particular embodiments, the firstcapacitive touch sensitive area is a “what” button, which allows a userto retrieve and play the audio signal stored in storage. In embodiments,the “what” button is configured to retrieve previously stored versionsof the amplified or unamplified representation of the audio signal.

In further example embodiments, the hearing assistance device maycommunicate with an electronic interface on another device, such as amobile phone, to control or monitor functions of the hearing assistancedevice. When the user controls the device through the electronicinterface, the electronic interface may translate the user input intocomputer readable instructions or electronic signals to be transmittedto processors in the frames to perform corresponding electronic tasks.For example, the user may configure the lag microphone sensitivity usingan option on the electronic interface, which in turn may be transmittedto the frames as an electronic signal to amplify the variable gain ofthe audio signals from the lag microphone. In some embodiments, anapplication programming interface (API) may be provided withinstructions and signals supported by the frames, so third-parties maydesign additional electronic interfaces to be used to control or monitorthe hearing assistance device.

In some embodiments, the electronic interface may allow the user to tunethe parameters of the audio signals processed by the hearing assistancedevice. The electronic interface may allow the user to tune theamplitude of volume, frequency, pitch, or other such equalization levelsfor the microphones, headsets/earbuds, Bluetooth modules, or othercomponents by sending corresponding instruments or signals to theframes. In some embodiments, the user may individually tune the deviceaccording to different activities or environments and store the settingsto switch back to in the future. In related embodiments, preset, defaultsettings for different activities and environments may be provided forselection of the user on the electronic interface, and the user may usethe default preset for an activity or fine tune and save the presetaccording to his/her own preference. In some embodiments, the device mayautomatically switch to certain presets for certain environments oractivities based on the user's actions, such as answering a phone call,or location, such as entering a restaurant.

In some embodiments, the hearing assistance device may provide languagetranslation. The device may include a converter configured to convertthe audio signal to a first digital representation of the audio signalwhich includes language translation of the speech into a first language.The device may also include a controller configured to perform speechrecognition of the first digital representation of the audio signal andthen compare the digital representation of the audio signal to a lookuptable stored in the memory. In other embodiments, the controller may usemathematical algorithms or spectral representation instead or inconjunction with the lookup table. The controller also configured toconvert the first digital representation of the audio signal to a seconddigital representation of the audio signal, wherein the second digitalrepresentation of the audio signal is a translation of the speech of thefirst language into a second language. The controller also configured toconvert the second digital representation of the audio signal to a voicemodulated audio signal including speech in the second language, which isoutput to the user through the ear bud speaker, or to an externalspeaker, or to computer readable text for visual display, transmissions,or such.

In some embodiments, the device may use speech recognition to enhancethe speech. In such embodiments, a converter may be configured toconvert a first audio signal to a first digital representation of thefirst audio signal. Then a controller may be configured to performspeech recognition of the first digital representation of the audiosignal, in which the first digital representation is translated to textand all noise not recognized as speech removed during the translation.In some embodiments, the controller may compare the text to a lookuptable in memory and generate corresponding new text in a differentlanguage. In other embodiments, the controller may use mathematicalalgorithms or spectral representation instead or in conjunction with thelookup table to generate corresponding new text in a different language.Then the controller may be configured to convert the text or new text toa second digital representation of a second audio signal and convert thesecond digital representation to an audio signal in a different pitch orfrequency than the first audio signal, which is output to the userthrough the headset or earbud speaker.

The controller may be configured to provide various other functions byconverting speech to text, and then optionally converting the text to anew audio signal of that speech. For example, in some embodiments, thecontroller may remove non-speech noise from the speech heard by theuser. In the same or different embodiments, the controller may beconfigured to amplify the audio signal at a low volume, and thenincrease the amplification when certain words or phrases are detected,which may aid in the user's ability to filter speech in varioussituations (e.g. noisy or chaotic situations). In other embodiments,when the audio is converted to textual representation, the text may alsobe visually displayed to the user or others on other devicescommunicated with the hearing assistance device, such as a mobile phoneor laptop, or on the lens of the glasses. In embodiments involvinglanguage translation, the controller may not only translate speech toanother specified language for the user, but the translation may bepresented to the user as text or new generated speech (using a differenthuman voice or modulated voice) that is easier for the user to hear thanthe original speech. In some such embodiments, the controller may beconfigured to allow two or more users, conversing in two or moredifferent languages, to each see text or hear the speech from the otherusers in that respective user's own native or chosen language, and maycommunicate back to the other users in that respective user's own nativeor chosen language.

In example embodiments, a pitch shift method is applied to the audiosignal received by a microphone of the hearing assistant device to allowthe user to hear the emitted amplified audio signal.

In example embodiments, the device further comprises a skull connection,wherein the audio signal received by the first transducer is convertedto bone conduction of sound through the skull connection. In some of theexample embodiments, the skull connection may be a cheek bone areaconnection.

In example embodiments, the device may further include an intercom modein which different users of the assistant hearing devices maycommunicate between the devices similar to walkie-talkies, usingBluetooth source and sync modes.

In example embodiments, the hearing assistant device further comprises atemple area connection to monitor vital signs.

In another example embodiment, the hearing assistant device may alsocomprise a visual assistant device by using ultrasound for echolocationto measure distances to surrounding objects, and then using themeasurements to generate tones, or other signals, based on the positionand/or distance to the objects. As a user moves or scans his or her headin different directions (e.g. left to right or up and down), the changesin tones generated by the visual assistant device may allow the user tohear an audio representation of the surrounding objects, or to receiveand/or communicate other signals (e.g., touch, visual stimuli, or text)representing surrounding objects.

BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing will be apparent from the following more particulardescription of example embodiments of the invention, as illustrated inthe accompanying drawings in which like reference characters refer tothe same parts throughout the different views. The drawings are notnecessarily to scale, emphasis instead being placed upon illustratingembodiments of the present invention.

FIG. 1 shows an example of a prior art over the ear hearing aidconfiguration.

FIG. 2A shows a hearing assistance device according to an embodiment andembodiments of the side of the frame of the disclosure.

FIG. 2B shows a hearing assistance device according to an embodiment ofthe disclosure highlighting embodiments of parts or pieces of the deviceincluding embodiments of the speaker.

FIG. 2C shows a hearing assistance device according to anotherembodiment of the disclosure highlighting embodiments of the speaker.

FIG. 2D shows a composition of a directional velocity ribbon microphoneaccording to an embodiment of the disclosure.

FIG. 2E shows a hearing assistance device according to anotherembodiment of the side of the frame of the disclosure.

FIG. 2F shows a hearing assistance device according to a differentembodiment of the side frame of the disclosure.

FIG. 2G shows a barrel-shaped connector according to an embodiment ofthe disclosure.

FIG. 2H shows example mockup images of how prototype boards may bemounted on the frames of the hearing assistance device according to anembodiment of the disclosure.

FIG. 2I shows additional example mockup images of how prototype boardsmay be mounted on the frames of the hearing assistance device accordingto an embodiment of the disclosure.

FIG. 2J shows example prototype boards according to an embodiment of thedisclosure.

FIG. 2K shows additional example prototype boards according to anembodiment of the disclosure.

FIGS. 2L, and 2L1 through 2L-6 show composite sketches according toembodiments of the disclosure.

FIGS. 2M-1 through 2M-11 show embodiments for connecting an earbud tothe frames of the hearing assistance device.

FIGS. 2N-1 through 2N-9 show views of the hearing assistance deviceaccording to embodiments of the disclosure.

FIG. 3 shows a system diagram of the hearing assistance device accordingto an embodiment of the disclosure.

FIG. 4A shows a detailed schematic of the hearing assistance device 400according to an embodiment of the disclosure.

FIG. 4B shows another detailed schematic of the hearing assistancedevice 450 according to a different embodiment of the disclosure.

FIG. 4C shows a user interface for tuning the hearing assistance device450 according to an embodiment of the disclosure.

FIG. 4D shows a second user interface for tuning the hearing assistancedevice 450 according to an embodiment of the disclosure.

FIG. 4E shows a third user interface for tuning the hearing assistancedevice 450 according to an embodiment of the disclosure.

FIG. 5A shows a hearing assistance device according to anotherembodiment of the disclosure highlighting embodiments of the circuitboard.

FIG. 5B shows a hearing assistance device according to a differentembodiment of the disclosure highlighting embodiments of the circuitboard.

FIG. 5C shows embodiments of the front sides circuit boards for thehearing assistance device

FIG. 5D shows embodiments of the back sides circuit boards for thehearing assistance device.

FIG. 6A is a schematic diagram of a computer network environment inwhich embodiments are deployed.

FIG. 6B is a block diagram of the computer nodes in the network of FIG.6A.

DETAILED DESCRIPTION

A description of example embodiments of the invention follows.

The teachings of all patents, published applications and referencescited herein are incorporated by reference in their entirety.

Hearing assistance devices such as hearing aids include sophisticatedelectronic components built in small compartments that are customized tofit the shapes of outer ear of users. The components of these hearingassistance devices are expensive to replace. For example, the speaker ofa hearing aid may be connected to the main body through an electricwire. The surface of the speaker may be clogged with foreign substances(such as ear waxes), and the speaker is easy to lose. Unfortunately, thereplacement cost for a hearing aid speaker is quite high. Further, sincethe electronic circuit of the hearing aid is cramped into a smallcompartment, the batteries for the hearing aid may be small and may needto be replaced more often due to the small size of the batteries.Additionally, hearing assistance or hearing assistant devices often havetubes coming out of the ear and can draw sometimes unwanted andembarrassing attention to the user's handicap because the tubes are ofnoticeable size. Therefore, there is a need for hearing assistancedevices that may cost less to build with long lasting batteries that areeasily replaced.

Hearing assistance or hearing assistant devices focus on processingsound, but these devices do little to assure that the best possiblesound comes in and out, for example, clarity of sound and natural sound.Many traditional hearing assistance or hearing assistant devices useonly digital signal processing and most can only process sounds up to 6kHz or 8 kHz, which is a major flaw that impacts the ability oftraditional devices to reproduce music or harmonics. Additionally,traditional devices do not have the ability to place the microphone ormicrophone array any appreciable distance from the ear. For example,many hearing assistance devices have the disadvantage of having themicrophone in your ear instead of in the best location for picking upsounds you want. Also, in traditional devices, the speaker is generallylocated close to the microphone. This limits the amount of signal gainthey can achieve because as gain increases, more of the sound from thespeaker will feed back into the microphone and cause feedback squeal.Therefore, there is also a need for hearing assistance devices withmicrophones placed to enhance clarity of audio signal and to decreasedistortion of audio signal.

Generally, there are two types of prior art hearing aids. There is anover the ear or behind the ear configuration, which is shown in FIG. 1,and there are in the ear configurations (not shown). Both configurationsare relatively expensive since these types of hearing aids includeexpensive and complex electronic components, which typically have beenoptimized for the user by an audiologist. Many over the ear and in theear hearing aids are customized for each user, thus making replacementexpensive. The over the ear hearing aid configuration shown in FIG. 1(commercially available from Oticon as the AgilePro) provides Bluetooth®connectivity via a transmitter that hangs over a person's neck. SuchBluetooth® hearing aids tend to be even more expensive, and suffer fromrapid battery drain. For instance, the typical battery life in aBluetooth® enabled hearing aid may last approximately two days. The inthe ear configurations may include the complex electronics inside theuser's ear. Both prior art hearing aid configurations, and especiallythe in the ear configurations, are non-discrete and can be unsightly asthey can alert others to the fact that the user of the device may behearing impaired.

System Overview

A hearing assistance system is provided that assists the transmission ofsound signals from microphones to ears of human subjects.

In some embodiments, the inventive device does not have any tubesprotruding or coming out of the ears rather the hearing assistancesystem is built into a device shaped like eyeglasses or glasses. In someembodiments, all electronics are stored in the glasses. Theconfiguration of the electronics for the hearing assistance system inthe glasses may help reduce costs because many hearing assistancedevices are expensive. Replacement of lost or broken hearing assistancedevices can be costly for the user because the entire device must bereplaced. In some embodiments, an earphone or ear bud is used in thehearing assistance system and is discretely connected to the glasses orbuilt into the glasses. A lost or broken part of the hearing assistancedevice of the invention, for example, an ear bud, can be replaced atlittle cost to the user because the cost of an ear bud is nominal.

The ear bud or earphone may have various shapes or styles and be made ofvarious materials. For example, a solid foam ear bud assists with noiseisolation, a thin mushroom shaped silicone earphone creates a light fit,a spherical soft foam provides comfort. In embodiments, the earphonesare made of soft rubber to create a seal that facilitates blocking outenvironmental noise. In example embodiments, the earphone includespassive noise-canceling padding. In some embodiments, the earphoneincludes high-density foam. The earphone may contain combinations ofmaterials. For example, the earphone may contain passive noise-cancelingpadding and high-density foam to prevent ambient sound waves fromreaching the user or interfering with the hearing assistance system. Incertain embodiments, the earphone is substantially free of electricalcomponents.

In some embodiments, the inventive device has a directional microphoneto help select useful sound signals for amplification and optionallyfurther processing. In embodiments, the directional microphone enhancesclarity of audio signals. In some embodiments, a third microphone, forexample, a mouth microphone is positioned to pick up the user's voicemore clearly. Capturing the user's voice as audio background may be usedto reduce the muffled sound a user hears of the user's voice, which isreferred to as the occlusion effect. This muffling effect can bemimicked by talking with a person's ears plugged, for example byearplugs. In some embodiments, an accelerometer may be used to detectnoise vibrations, such as the user's voice, and adjust the audio signalsto reduce the volume of the noise vibrations. In some embodiments, amouth microphone may provide a better audio transmission of the user'svoice for connection to your phone.

In some embodiments, the audio signal is processed as an electronicanalog signal. Analog processing preserves the directionality of anaudio signal by preserving the time delay of audio signal received attwo or more microphones. Analog processing may occur at the speed oflight allowing for contemporaneous signal processing. Digital signalprocessing (DSP) leads to processing delay with conversion of audiosignals dependent on the computing system performing the mathematicaloperations. Processing an electronic analog signal allows more,fine-tuned control and clarity compared to the blunter control of DSPwhere initial processing starts with a more distorted signal.

Electrically Powered Earphone or Earbuds

In some embodiments, the earphone (or the earbud that may be attached toan earclip) may be electrically powered by an interface with the glassesframe. In embodiments, the earphone includes active noise-canceling tomask low-frequency sound waves of ambient noise and to cancel unwantedsound. In some embodiments, the earphones have batteries. In someembodiments, the earphones are batteryless. In some embodiments, theframe provides a power source to an earphone. In some embodiments, theearphones are configured to be electrically powered by respectiveconnections made to portions of the frame. For example, the earphone maybe electrically powered by the frame. A fastener or connector may beprovided that facilitates an interlock and electrical connection betweena portion of the earphone and a portion of the frame. If the electricalconnection between the earphone and the frame is lost, the earphone maybe without electrical power. In embodiments, the earphone contains acombination of materials and electrical components.

Embodiments of the disclosure may include a device that includes atleast one first transducer for receiving sound signals, at least onesecond transducer for emitting sound signals, and at least one extensiontube coupled to the at least one second transducer, in which the atleast one extension tube may include a hollowed core from a first end toa second end of the at least one tube. In one embodiment, the first endof the at least one extension tube is sealed with a first membrane, andthe second end of the at least one extension tube is sealed with asecond membrane. In one embodiment, the hollowed core of the at leastone extension tube contains inert gases including air, noble gases, andnitrogen.

Psychoacoustic Earphone

In one embodiment, the earphone (or the earbud that may be attached toan earclip) may be configured to transmit sound using technology similarto a conventional stethoscope. In an example embodiment, the hearingassistance system is a device with a frame coupled to a hollow tube. Insome embodiments, the hearing assistance system is a device with aspeaker in a frame coupled to the hollow tube. In some embodiments, theframe also includes an amplifier chip. The hollow tube may harnessproperties of the amplified representation of the audio signal, forexample, an acoustic amplified representation of the audio signal, suchthat the acoustic amplified representation of the audio signal bouncesor reflects off of the inside walls of the hollow tube. The mechanism ofamplification of the audio signal may involve multiple reflections. Thehollow tube may be made of various materials including rubber or metal.

In some embodiments, the hollow tube may be made of a lightweightmaterial. In some embodiments, the hollow tube may be flexible. Inembodiments, the hollow tube may allow absorption of sound or audiosignal from outside of the hollow tube. In embodiments, the hollow tubemay reflect audio signal from inside of the hollow tube to the outsideof the tube. The tube may be inserted into a user's ear. In embodiments,the tube may be coated to optimize various properties of the hollowtube. For example, a fuzzy material or coating may be used to blockexternal noise similar to a microphone windsock.

In some embodiments, the hollow tube may have a varying thickness. Thedifferent hollow tube diameters may be used to optimize variousproperties of the hollow tube. The inner diameter of the tube comparedto the outer diameter may be such that the hollow tube has a giventhickness. For example, the hollow tube may have an outer diameter of3/32″ and an inner diameter of 1/32″ for a hollow tube wall thickness of1/32″. For example, the hollow tube may be medical grade tubing. In someembodiments, the hollow tube may be Flexelene™ Tubing FX.

In embodiments, the hollow tube has a flexible, thin membrane like apassive radiator membrane. In some embodiments, the audio signalvibrates the membrane allowing for more efficient sound transmission,especially at lower frequencies. The membrane may remove echo effects.

In embodiments, an earphone is configured with a hollow, rubber tube.For example, the amplified representation of the audio signal isreverberated inside the walls of the rubber tube and emitted to theearphone. The earphone may be used to hold the hollow tube in place andmay be used to block external sound.

In some embodiments, the hollow tube is connected to a set of metaltubes. The set of metal tubes may carry the amplified audio signal instereo to the user. In some embodiments, the metal tubes may beconnected to earphones of the hearing assistance device.

Wearable Computing System Architecture

In one embodiment, the device may be wearable by a human subject. Insome embodiments, a device may be mounted on a frame configured to beworn on the head of a user, the frame including a bridge configured tobe supported on the nose of the user. In one specific embodiment, thedevice may be mounted on human head in the form of a glass frame. Theglass frame may include two rims to hold glasses, two temples eachcoupled to one rims, and a bridge that connects the two rims. In someembodiments, the first temple (the first side) is configured to bepositioned over a first temple of the user with the free end disposednear a first ear of the user while the second temple (the second side)is configured to be positioned over a second temple of the user with thefree end disposed near a second ear of the user. In some embodiments,the sides or arms of the frames may be less than 5 mm high. In preferredembodiments, the sides or arms of the frames may be about 3 mm high.

In one embodiment, the at least one first transducer may include atleast two microphones configured to receive an audio signal includingspeech. In some embodiments, the at least two microphones are positionedsuch that a first lag microphone is situated at a rear portion of afirst side of the frame and a second microphone is situated at a frontportion of the frame, for example, at a front portion of one side of theframe or a ribbon microphone at the bridge of the frame. In oneembodiment, the at least one first transducer may include a leadmicrophone and a lag microphone where the lead microphone is arranged tobe situated at a front portion of one temple of the glass frame and thelag microphone is arranged to be situated at a rear portion of one sideof the glass frame. In example embodiments, the lag microphone issituated at a location on the rear portion of one side of the frame suchthat the lag microphone is not placed behind the ear canal entrance.Additionally, the lag microphone is situated at a location wherein thedistance between the speaker and the lag microphone on the frame allowsincreased signal gains without causing the user to hear feedback noise,such as squealing. In example embodiments, the second microphone, forexample, a lead microphone is situated at the front portion of one sideof the frame such that the user's head blocks sound. For example, a leadmicrophone on the right side of the frame is positioned so that theuser's head blocks sound coming from the left side. The lead microphoneand the lag microphone may be directional microphones that are orientedto receive sound input from a particular direction. In some embodiments,the first and second microphones may be directional microphones that areoriented toward the front of the frames.

In one embodiment, the at least one first transducer may include a thirdmicrophone that may be arranged to be situated on one rim of the glassframe below the bridge. The third microphone may be oriented towardbelow for capturing sound from the mouth of the human subject. In someembodiments, the first transducer further comprises at least onemicrophone (a third microphone) configured to receive an audio signalincluding speech from the user. In example embodiments, the thirdmicrophone is situated as close to the user's mouth as possible toreceive audio signal consisting essentially of the user's speech. Insome embodiments, the user's speech is input as audio background toreduce effects such as muffling or distortion of sound and the occlusioneffect. In embodiments, the third microphone receives the user's speechas auditory instructions. In some embodiments, the auditory instructionsfrom the user are translated into computer readable instructions, whichdirect one or more computer processors. The computer processors may beembedded in the frame to perform electronic tasks. The computerprocessors may be external to the hearing assistance device and accessedeither through a wireless connection or a direct connection to anexternal device such as a mobile phone.

In some embodiments, user instructions may be communicated to thehearing assistant device using an electronic interface on anotherdevice, such as a mobile phone, to control or monitor functions of thehearing assistance device. When the user controls the device through theelectronic interface, the electronic interface may translate the userinput into computer readable instructions or electronic signals to betransmitted to one or more processors on the frames to performcorresponding electronic tasks. For example, the user may configure thelag microphone sensitivity using an option on the electronic interface,which in turn may be transmitted to a processor on the frames as anelectronic signal to amplify the variable gain of the audio signals fromthe lag microphone. The user may use the electronic interface to controlor monitor various functions regarding the various microphones,including volume, pitch, frequency, and other components of the audio.In some embodiments, an application programming interface (API) may beprovided with instructions and signals supported by the frames, sothird-parties may design additional electronic interfaces to be used tocontrol or monitor the hearing assistance device.

In embodiments, a second transducer may emit the amplifiedrepresentation of the audio signal to, for example, a speaker. Inexample embodiments, the speaker is an earphone coupled to an ear of theuser. At least a portion of the earphone may be removably coupled to atleast a portion of the frame. For example, when the earphone is incontact with the portion of the frame, the earphone is configured toemit the amplified representation of the audio signal to an ear of theuser.

In some embodiments, the hearing assistance device may further comprisea third transducer. In embodiments, the third transducer may emit theamplified representation of the audio signal to, for example, a speaker.In example embodiments, the speaker is a second earphone coupled to asecond ear of the user. At least a portion of the earphone may beremovably coupled to at least a portion of the frame. For example, whenthe second earphone is in contact with the portion of the frame, thesecond earphone is configured to emit the amplified representation ofthe audio signal to a second ear of the user. Therefore, in someembodiments, the hearing assistance device may comprise a frameconfigured to be worn on the head of the user, three transducers, atleast two microphones, and two earphones configured to emit an amplifiedrepresentation of the audio signal to the ears of the user.

The audio signal may, for example, be speech, real-time audio input,recorded audio input, or auxiliary audio input. A converter may beconfigured to convert and to amplify the audio signal to an amplifiedrepresentation of the audio signal. The amplified representation of theaudio signal may be, for example, an electronic amplified representationof the audio signal or an acoustic amplified representation of the audiosignal.

The at least one second transducer may include a speaker that may bearranged to be situated toward the tip of the side of the glass frame.The speaker may include a tongue on which the first end of the extensiontube is coupled to. When coupled to the tongue, the first membrane atthe first end of the extension tube may be pressed against the tongue.The extension tube or hollow tube may also be attached to the glassframe using a connector (e.g. v-shaped, cone-shaped, or barrow shapedconnector). For example, the attachment may be formed magnetically suchas through the use of a ring magnet. The second end of the extensiontube may be inserted into the inner ear of the human subject to receivesound from the speaker. The hollow tube may be made of various materialswith an optional coating. In embodiments, the first membrane is aflexible plastic membrane that vibrates in response to the amplifiedrepresentation of the audio signal. In some embodiments, a flexiblehollow tube is configured with a flexible plastic membrane. In exampleembodiments, the flexible plastic membrane vibrates in response to soundwaves transmitted from the speaker in the frame and through the hollowtube. In some embodiments, the hollow tube optionally configured with aflexible plastic membrane is connected to an earphone. In embodiments,the tube or passive radiator is connected to the speaker through amagnetic connection. In some embodiments, the speaker connection to thehearing assistance device is wireless.

In some embodiments, the speaker is connected to the hearing assistancedevice with a wire. The wired speaker may include a ring magnet that isoptionally a ring magnet connection. In example embodiments, the hearingassistance system includes underneath the flexible plastic membrane of aspeaker is a metal coil that is configured to be coupled to a magnetportion of the frame. In embodiments, the metal coil portion of theearphone makes electromagnetic contact with a portion of the frame. Theelectromagnetic contact may magnetize the metal coil of the speakercausing the flexible plastic membrane of the speaker to vibrate andthereby transmit the amplified representation of the audio signal intothe user's ear. In some embodiments, the speaker is coupled to theearphone. In some embodiments, the wired speaker is adjacent to theearphone.

The device may further include an electronic circuit coupled to themicrophones and to the speaker. The electronic circuit may convert soundsignals received at the microphones into electronic signals, suppressnoise, selectively amplify useful sound signals, and output the cleanedand amplified sound to the speaker. The electronic circuit may includean accelerometer which may detect noise vibrations, such as the user'svoice or banging the glasses, and adjust the volume of the noisevibration in the sound signals. The electronic circuit may be embeddedin one side of the glass frame.

Directional Microphones

In some embodiments, the microphones are directional. In someembodiments, an analog signal is received by the microphones. Inembodiments, the difference in time between the lead microphone and thelag microphone receiving sound signals may assist the system inselectively amplifying useful sound signals. For example, the leadmicrophone may amplify positive audio signal while the lag microphonemay amplify negative audio signal so that audio signal or sound arrivingfrom the side of or behind the glasses frame subtracts out. As anillustration if the lead microphone receives an audio signal of 1.0, andthe lag microphone receives an audio signal of −0.6, then the system isleft with an audio signal of 0.4, which makes the audio signaldirectional.

In some embodiments, the cleaned and amplified sound signals may undergofurther processing using, for example, digital signal processing.Examples of further processing include applying equalizers, frequencyshifting, dynamic range compression, and frequency compression. The usermay adjust the levels of such using an electronic interface which maytransmit the adjustments as signals to a processor on the hearingassistant device. The processor may apply these signals as variablegains to amplify the sound signals at the microphones.

Directional microphones, for example, the lead microphone, lagmicrophone, mouth microphone, and ribbon microphone, of the hearingassistance device are in better locations to pick up or capture usefulaudio signals. In embodiments, the directional microphone enhancesclarity of audio signals. In some embodiments, a third microphone, forexample, a mouth microphone is positioned to pick up the user's voicemore clearly. Capturing the user's voice as audio background may enhanceclarity and may mimic natural sound environments better while reducingeffects such as the occlusion effect. In some embodiments, a mouthmicrophone may provide a better audio transmission of the user's voicefor connection to your phone.

In some embodiments, the analog audio signal is like the negative of aphotograph while a digital audio signal is like an old photograph. Theold photograph can be restored by digital processing, but there is alimit on the clarity and improvements that can be made to the oldphotograph by processing. However, by using a negative to make a newphotograph, the result is as good as one can make it. The analog audiosignal can also be compared to higher resolution photographs. Forexample, the evaluation of the photographs taken by spy planes is onlyas good as the resolution of the cameras. The evaluation can continue tozoom in on a low resolution photograph, but it's harder and harder tomake sense of the picture because of distortion and pixilation.Evaluation by sharpening the image to try to make sense of thephotograph can be tried, but sharpening the image introduces artificialelements to the photograph based on how the digital processingidentifies the edges and other features. The better solution is to takea higher resolution picture in the first place and to print that imagein high resolution.

Furthermore, typical hearing aids may only process sounds up to 6 kHz or8 kHz, which impacts the user's ability to reproduce certain sounds,such as music. Using the analog audio signal, the device may extend to20+ kHz allowing the full range of audio to reach the user, includingharmonics which may be critical in the case of certain hearingdeficiencies. For example, if a user has a deficiency hearing 6 kHz, thedevice may reproduce a first harmonic of 12 kHz to attempt to allow theuser to better hear the 6 kHz frequency. The human brain uses aphenomenon called “missing fundamental” in which the brain may detect afrequency that is not actually present by detecting the first harmonicof 12 kHz. That is, by the device producing a strong 12 kHz signal, theharmonic of the 6 kHz sound in this example, the user will detect the 6kHz frequency. This phenomenon is most commonly known in commontelephone systems, which typically filter out sounds lower than 300 Hz,although a male voice has a fundamental frequency approximately 150 Hz.Because of the “missing fundamental” effect, the fundamental frequenciesof male voices are still perceived as their pitches over the telephone.

Power Supply

In one embodiment, the device may further include a rechargeable batteryto supply powers to the electronic circuit. In one embodiment, the shapeof the rechargeable battery is a tube that may constitute part of theside of the glass frame. In one embodiment, the electronic circuit andthe rechargeable battery is on a first side of the glass frame, and thefront microphone, lag microphone, and the speaker is on a second side ofthe glass frame. In embodiments, a rechargeable battery is located oneach side of the frame in order to balance weight. In some embodiments,the size and weight of a rechargeable battery located on a first side ofthe frame is different from the size and weight of a rechargeablebattery located on a second side of the frame. In some embodiments, thepower supply is provided by a custom battery similar to a “lipstick”battery for phone charging or the battery used in electronic cigarettes.The battery may contain a metallic flat side so that the battery may beattached to the side of the frame through magnetic attraction. Inexample embodiments, the battery may also be magnetic (contain magnets).In some embodiments, the rechargeable battery is a lithium-ion battery.In some embodiments, the rechargeable battery is a lithium-polymerbattery. The lithium battery may include a battery regulation/chargingcircuit board inside the battery or inside the battery case. The batterycase or main casing may be designed in various styles, shapes and colorsso that the battery may form part of the frame design. Aregulation/charging circuit board may increase stability and preventfire or combustion. In embodiments, the circuit board containsregulation/charging circuitry including the mini-USB charge inputconnector.

The rechargeable batteries may have varying storage capacities that mayaffect battery lifetime. In some embodiments, the mAH capacity rating(measured in milli-ampere hours) refers to how much current a batterywill discharge or deliver over a period of time (typically a one hourperiod). For example, the battery may supply about 850 mAH at 5 volts.

Cone Shape Interlock/Connector

The earphone may include a cone shaped interlock (connector) tointerface with the glasses' frame to facilitate sound transmission. Theinterlock/connector portion at the earphone may be configured in a malecone shape. The interlock/connector portion in the glasses frame is afemale funnel shaped hole. In embodiments, the female funnel shape holebottom half electrically connects speaker (plus), then a gap of 1 mm,then the top half will electrically connects speaker minus.

The earphone may be configured with a matching cone male funnel shapeinterlock/connector, while the frame of the glasses is configured usinga female funnel (hole), which includes a ring magnet around its outside,and the male funnel is steel. In this way, the male and femaleinterlock/connectors attract and make the connection. In embodiments,the funnel shapes are relatively small, e.g. about 3 mm round, 4 mmdeep. The female funnel includes 2 or 3 spring-action copper tabs on theinner walls to provide sufficient contact (similar to a house phonecharging docking station).

V-Shaped Interlock/Connector

In a similar embodiment to the cone shape interlock/connector, analternate V-shaped connector may be used to connect an earbud to theframes. In this embodiment, an earbud may attach to an arching shapedearclip that may be positioned over the user's ear. At the top of theearclip is a ball joint with an attached male “V” shapedinterlock/connector made of plastic with copper or steel sheetingbeneath. A strip with a female “V” shaped hole also made of plastic withcopper or steel sheeting may be mounted on the glasses where the earmeets the skull. Preferably, the strip is aligned with thin magnets, andthe thin magnets have to be strong enough to have a secure electricalcontact, yet not so strong that as to pulls the earbud out when removingthe glasses or interfere with the microphones. The male “V” shapedconnector on the earclip fits into the female “V” shaped hole on themounted strip, and the thin magnets pull the connection tight, in thesame manner as the coned shaped connector.

The “What” Button

The device may further include a number of touch sensors on the sides ofthe glass frame to receive instructions from the user. The touch sensorsmay be coupled to the electronic circuit which is to perform thefunctions of the instruction. In one embodiment, the device may includea touch button which, when activated by pushing the button, sometimesreferred to herein as a “what” button, is to cause an audio clip (orother captured data) to be replayed. A “what” button may be configuredto retrieve previously stored versions of the amplified or unamplifiedrepresentation of the audio signal.

Tuning Software

Tuning software may be provided to enable volume, frequency, harmonic,and other equalization adjustments to the audio transmitted from theglasses frame to the earphone. The tuning software may be controlledthrough an electronic interface on, for example, a mobile phone tooptimize the sound quality of the audio transmission to theuser/listener so that it is customized to address the listener/user'shearing deficits. The tuning software may be configured to allow theuser/listener to customize sound quality for specific environments oractivities engaged by the user/listener. The user/listener may beprovided with default setting for particular environments andactivities, such as watching television at home, and may use the defaultsetting or further fine tune and save the setting for that preset.

In some embodiments, a user/listener may be provided default volume,frequency, harmonic, and other equalization levels for an environment(e.g. at a restaurant), and may want to fine tune those levels tohis/her own preference based on his/her hearing deficits. From theelectronic interface, the user may select the “Restaurant” preset optionto set the default restaurant setting, and then may use options on theelectronic interface to further tune the default restaurant settings.The electronic interface may allow the user to tune lead and lagmicrophone components, such as tuning the lead microphone sensitivityand lag microphone sensitivity to adjust the amplitude of the audiosignals from the lead and lag microphones. The device may also includean accelerometer which may be used to reduce vibration noise, and theelectronic interface may allow the user to tune the sensitivity of theaccelerometer and the reduction in volume due to a detected vibration.Similarly, the electronic interface may allow the user to tune theearbud/headset or Bluetooth microphone, such as tuning the earbudnoisegate to filter noise from the signal or earbud sensitivity toadjust the amplitude of the signal at the earbud microphone. Theelectronic interface may further allow the user to tune the volume ofthe left and right speakers. Then, the electronic interface may alsoallow the user to save the results of these adjustments under the same“Restaurant” option to use again the next time the user is at arestaurant. The user may switch between the presets as their environmentor activities change by selecting the corresponding preset on theelectronic interface. For example, the user/listener may be watchingtelevision at home using the “Home TV” preset, then receives a phonecall and switches to the “Phone Call” preset, and when the phone callends, switch back to the “Home TV” preset.

In some embodiments, the device may automatically switch to certainpresets for certain environments or activities based on the user'sactions, location, or selected audio type ( e.g. ambient sound,streaming music, phone call, or sound in/out to an offboard computingdevice such as a smartphone). In some embodiments, a mobile phone orother device may send a signal using an electronic interface to thehearing assistance device with the user's location, for exampledetecting the user entered a theater or a restaurant, or the user'sactions, for example answering a phone call and the device mayautomatically switch to an appropriate preset mode. In otherembodiments, the hearing assistance device may detect the location oraction directly, without the use of another device and may automaticallyswitch to an appropriate preset mode. For example, the user may have thedevice set to normal listening mode, but then a phone call may bereceived, and the hearing assistance device may detect the phone calland automatically switch to the “Phone Call” preset. When the call hasended, the device may then automatically switch back to the previousmode, in this example normal listening mode. The automatically switchingis a preferred embodiment of the device because modes have differentsettings that are sometimes incompatible with certain environments oractivities, and manually switching may cause an inconvenience to theuser. For example, the user may want to talk on the phone using thedevice, without the automatic switching function, the user would have tomanually switch to the “Phone Call” preset or adjust the settings to beable to speak/hear on the phone. Then when the call was ending, the userwould have to manually adjust the settings (e.g. volume, frequency)prior to the end of the call, or else the “Phone Call” settings maycause various hearing issues for the user (e.g. feedback) now that theuser is no longer on a phone call.

In one embodiment, the tuning software provides pitch shift tuning, sothat the user/listener is able to shift the frequency of the audioreceived at the earphone so that it is the range that the user/listenercan her. Some listeners that are hearing impaired may be able to hearcertain frequencies well, while they are unable to hear otherfrequencies. Conventional hearing aids tend to address this typically byamplifying the sound, which could potentially further degrade the user'shearing. However, with the inventive shift tuning, the user/listener canshift the frequency of the audio so that all audio transmitted to theearphone is within the range that the user/listener can hear. In thisway, further hearing degradation may be avoided since frequencies thatthe user/listener is unable to hear are not amplified, which can bepotentially deafening (further hearing loss) over time.

The tuning software may be configured with psychoacoustic harmonicamplification. With missing fundamental phenomena, for example, alistener/user may only be able to hear at 200 hertz; since allfrequencies have harmonics, if the listener/user cannot hear at 200hertz, the invention may amplify the harmonics of the signal at 800hertz, or 1600 harmonics. By hearing the harmonics, the brain of theuser/listener assumes the fundamental is there and hearing may beimproved without increasing the overall volume of the audio.

The tuning software may be configured with a basilar membrane equalizer.The basilar membrane in the ear has critical bands, such that each areaalong the membrane can hear a series of sound. The tuning software mayoptimize the audio so that it matches the basilar membrane.

Hearing Protection

Embodiments of the disclosure may include hearing protection that blocksor suppresses damaging environmental noise. These embodiments mayprotect the wearer by blocking sound waves of damaging environmentalnoise from reaching the wearer's ears, including masking damaging soundwaves of high-frequency and low-frequency noise. Some of theseembodiments include earbuds made of soft rubber that fit directly in theears and creates a seal with the ears that facilitates blocking damagingenvironmental noise. These embodiments may further block the damagingenvironmental noise by the use of earbud material, such as passivenoise-canceling padding and solid high-density foam, which increases theamount of dB in isolation for the earbuds. Some of these embodiments mayalso block the damaging environmental noise by the use of activenoise-canceling to mask specific frequency sound waves of damagingenvironmental noise, and to cancel or reduce the unwanted sound.

Thus, in these embodiments, the wearer may be protected from ambientsound waves reaching his/her ears, and instead only hear sound outputthrough the device at the audio levels configured at the device. Forexample, the earbuds in these embodiments may provide a minimum of 25 dBof sound isolation, but the wearer may set the audio level on the deviceto +25 dB so that the device may output sound to the wearer nearly as ifthe earbuds are not in the wearer's ears.

Embodiments of the disclosure may protect the wearer from damagingenvironmental noise by automatically adjusting the amplitude of thesound output to the wearer. In some of these embodiments, when theamplitude of volume, frequency, pitch, or other such audio parametersdetected by the device are determined to be at damaging levels, thedevice may automatically adjust the amplitude of each parameter to alevel safe for the wearer. Further, the wearer may also configure apreset to tune the amplitude of volume, frequency, pitch, or other suchaudio parameters to preferred safe levels according to differentenvironments. As such, if the wearer knows that in certain circumstanceshe/she may be exposed to damaging environmental noise, the wearer mayproactively configure a preset with preferred safe levels for switchingto when in that environment.

The hearing protection embodiments of the device may be useful for anyindividual exposed to damaging noise, such as working at a constructionsite, attending a concert, or in various military environments. Forexample, in the context of the military, the troops may be supplied withan embodiment of the device that utilizes earbuds with noise-cancelingpadding and solid high-density foam. As such, the troops may only hearsound output through the device at the audio levels configured at thedevice. The device may then automatically adjust audio levels whentroops are exposed to damaging noise. Further, a preset may also beconfigured for each soldier to switch to a preferred safe level for aparticular environment when exposed to damaging noise, such as nearbattle, near a helicopter, other such military environment.

Heightening Hearing Capabilities

Embodiments of the disclosure may allow the wearer to hear soundsoutside of normal hearing capabilities, acting as “binoculars for theears.” In some embodiments, a pitch shift method is applied to the audiosignal received by a microphone of the hearing assistant device to allowthe user to hear emitted amplified audio signal. In some embodiments, byraising or lowering the original pitch of the received signal, the pitchshifting method allows a user to hear sounds (emitted and optionallyamplified audio signals) normally outside of the detectable frequencyrange of the inner ear, or outside the detectable frequency range ofhuman hearing, by shifting the input audio spectrum or signal. Forexample, a wearer may detect an audio signal in the 50 kHz frequencyrange, but the pitch shifting method may shift the audio signal byone-tenth to an audio signal of 5 kHz. At this heightened hearing level,the wearer may detect sounds normally inaudible to a human, such as,detecting bearing problems in a jet engine. In some embodiments, theshifted audio signal may undergo further processing include applyingequalizers, frequency shifting, dynamic range compression, and frequencycompression, which may be applied by the device processor as variablegains to amplify the sound signals at the microphones. This may be usedfor notch filtering the sound to detect certain sounds while removingother sounds. The levels of these parameters may be configured using anelectronic interface, such as an app on a mobile device, to a preferredsetting, and then transmitted to the hearing assistant device processorfor application.

Embodiments of the disclosure may include other features that aid inenhancing the receiving and adjusting of audio signals to allow thewearer to hear sounds outside of normal hearing capabilities. In someembodiments, the inventive device has a directional microphone to helpselect useful sound signals for amplification and optionally furtherprocessing. In some of these embodiments, the directional microphoneenhances clarity of audio signals. Furthermore, in some embodiments, athird microphone, for example, a mouth microphone is positioned to pickup the user's voice more clearly. Capturing the user's voice as audiobackground may be used to reduce the muffled sound a user hears of theuser's voice, which is referred to as the occlusion effect. See FIG. 3.Moreover, in some embodiments, an accelerometer may be used to detectnoise vibrations, such as the user's voice, and adjust the audio signalsto reduce the volume of the noise vibrations. See FIG. 4B.

In some embodiments, the device may use speech recognition to enhancethe received speech to allow the wearer to hear sounds outside of normalhearing capabilities. In such embodiments, a microphone receives anaudio signal of speech by individuals in proximity to the user orsource. The microphone is connected to a converter or a transducer thatconverts the first audio signal to a first digital representation of thefirst audio signal. The digital representation may be enhanced byconverting in a manner to remove or reduce noise besides theindividuals' speech. Then a controller may be configured to performspeech recognition of the first digital representation of the audiosignal, in which the first digital representation is translated to textand all remaining noise not recognized as speech of the one or moreindividuals is removed during the translation. The text format may befurther enhanced to adjust the speech of a subset of the one or moreindividuals located outside of the detectable frequency range of humanhearing.

The controller may be further configured to also convert the text to asecond digital representation and convert the second digitalrepresentation to a second audio signal in a different pitch andfrequency than the first audio signal (i.e. new speech), and may furtheradjust the digital representation to allow the wearer to hear soundsoutside of the detectable frequency range of human hearing, which isoutput to the user through the headset or ear bud. The new generatedspeech may be output to the user as a different human voice or modulatedvoice that is easier for the user to hear than the original speech. Insome embodiments, the controller may completely remove or reducenon-speech noise from the speech heard by the user. In the same ordifferent embodiments, the controller may be configured to amplify theaudio signal at a low volume, and then increase the amplification whencertain words or phrases are detected, which may aid in the user'sability to filter speech in various situations (e.g. noisy or chaoticsituations). As such, the adjusted audio signal may now allow the wearerto hear speech that may be outside of normal hearing capabilities.

The heightened hearing capabilities embodiments of the device may beuseful for various applications apart from addressing hearingdeficiencies, including military intelligence, journalism, andautomotive repair.

Physiological and Physical Measurements

Embodiments of the disclosure may include sensors for physiological andphysical measurements. In these embodiments, the sensors may be placedin varying location on the frame of the hearing device to takemeasurements of the wearer's vital signs and other such functions, ormay be used to take such measurements of another individual. In some ofthese embodiments, a sensor may be place on both arms of the frames nearthe front in order to provide connection to the temple area of thewearer. In some embodiments, a sensor may be placed in other areas onthe arms of the frame as a capacitive touch sensitive area that thewearer my touch with his/her finger, wrist, or other body part. In theseforegoing embodiments, the sensors may measure vital signs, such aspulse/heartbeat, temperature, blood pressure, respiratory rate, andblood oxygen saturation; skin resistance; brain functions; or other suchfunctions. In some embodiments, a sensor may be place on the lens of theframes to measure eye functions, and in some embodiments a sensor may beplaced on the front bridge of the frames to measure nasal functions. Insome embodiments, a sensor may be placed on the arm of the frames totake additional physical measurements, such as measuring odor, airquality or airborne contaminants, vibrations, visual movements,temperature, or any other related measurement. The device may includevarious other sensors or components without limitation for takingvarious physiological and physical measurements, and the deviceprocessor provides interfaces to allow flexibility for incorporating anyadditional sensors or components into the device. The sensors maycapture measurements in these embodiments and other embodiments by bothtransmitting and receiving electronic signals, sound waves or pulses(e.g., ultrasound), light pulses, x-rays, odor detectors,accelerometers, or radiation, or by any other means of capturingphysiological or physical measurements.

Embodiments of the disclosure may further process the physiological andphysical measurements as part of medical applications. In someembodiments, circuits positioned in the frames may process themeasurements as collected by the device sensors to perform medical testsor procedures, such as an Electrocardiogram (EKG),Electroencephalography (EEG), Galvanic Skin Response (GSR), a StressTest, a hearing test (e.g., audio hearing range test), or any other suchmedical test or procedure. In some embodiments, the medical tests orprocedures may be performed directly by the circuits positioned in theframes or other components incorporated into the frames or otherwisecommunicatively connected to the frames. In some embodiments, thecollected measurements may be communicated to another device using wiredconnections, Bluetooth, WiFi, or other such communication connectionsfor performing the medical tests or procedures. In some of theseembodiments, the collected measurements may be communicated to a medicaldevice, such as an EKG machine or vision testing equipment, forperforming the medical tests or procedures. In other embodiments, thecollected measurements or results of the performed tests or proceduresmay be communication to a computing device, such as a smartphone ortablet, for processing by means of a medical program or app, or fordownloading for viewing by an individual, such as the wearer forself-quantization or a medical professional.

In some embodiments, the results of the physiological or physicalmeasurements may be used to adjust or tune the hearing assistancedevice. For example, if the device performs an audio hearing rangetesting using the device, the device may then use the results of thetesting to adjust the setting of the device (e.g. volume, frequency,pitch, or other such audio parameters). In some embodiments, the audiohearing range testing with optional adjustment is provided by a tuningboard or an application on a device such as a mobile phone, tablet, orcomputer. In some embodiments, the hearing assistance device furthercomprises an external tuning board with buttons. In example embodiments,the tuning board is small, for example a 1.5 inch by 3 inch board withbuttons. For example, see FIGS. 5B, 5C, and 5D.

Embodiments of the disclosure may further process physical measurementsof the surrounding atmosphere. In some embodiments, chemical sensorspositioned on the frames of the device may be configured to take samplesof the surrounding atmosphere to test for contaminates in the air or anyother properties of the air that would affect air quality (e.g.humidity). In some embodiments, circuits positioned in the frames orotherwise connected to the frame may process the samples to detectdangerous conditions, such as a toxic chemical present in the air, smokein the air indicating a fire, or elevated humidity levels. The devicemay directly indicate a warning to the wearer (e.g., a warning alarm) orto some other party or device. In some embodiments, the collectedsamples are transmitted to another device using Bluetooth, WiFi, orother such communication connections, such as a mobile phone, tablet, ora system for testing air quality. That other device may performadditional testing regarding the samples, may present the samples forreview by the wearer or air quality expert, or may warn the wearer invarious manners.

Embodiments of the disclosure may further process physical measurementsregarding vibration. In some embodiments, accelerometers are present inthe circuits positioned in the frames of the device and may be used insome embodiments to collect vibration measurements. For example, thevibration measurements may be used as part of an exercise application,such as to determine steps walked or miles run by the wearer. Thecollected measurements may be further transmitted to a mobile phone appto analyze or report statistics or other information related to thecollected data. For another example, the vibration measurements may beused to detect safety conditions regarding the wearer, such as thewearer falling down, suffering a seizure, or falling asleep during adangerous activity (e.g., while driving). The circuits positioned in theframes or other components connected to the frames may take actions inresponse to the vibrations measurements, such as trigger an alarm in theexample case of falling asleep while driving.

In some embodiments, if the collected measurements or performed tests orprocedures indicate a medical or health emergency, the device mayautomatically initiate communication with an emergency response service(e.g., an ambulance service), a configured contact (e.g., familymember), or a medical or health service, or automatically initiate anyother emergency related response. The emergency response may becommunicated using Bluetooth, WiFi, or any other communicationconnections. In some embodiments, the device may attempt to prompt thewearer for confirmation prior to initiating an emergency relatedresponse.

Embodiments of the disclosure may allow different options for collectingthe physiological measurements. In some embodiments, the wearer mayprompt the device to start and stop taking measurements, or the devicemay stop taking measurements when measurements are complete. In someembodiments, the wearer may set a timer to start and stop takingmeasurements. In some embodiments, the device may automatically starttaking measurements based on monitoring for events, such as sensing avibration, elevated temperature, or elevated pulse. For example, when auser starts exercising (e.g., running), the system may automaticallystart measuring the wearer's heart rate and temperature based ondetecting vibration, elevated pulse, or elevated temperature cause byengaging in the exercise. In another example, the measuring of vitalsigns may be based on sudden vibration detection by the device, such asthe wearer falling, or suffering a medical situation such as a seizure.

Further Example Implementations

Embodiments of the disclosure may include a device including a firstmember and a second member coupled to a first end of the first member.The device may include a third member coupled to a second end of thefirst member. The second and third members may be coupled to the firstmember through a respective hinge. The first member may further includea conduit inside the first member and a number of through holes thatextend from a surface of the first member to the conduit. In anembodiment, the through holes may face substantially the same direction.Further, a first subset of the through holes may be placed in a middleportion of the first member, and a second subset of the through holesmay be placed toward the first end of the first member, and a thirdsubset of the through holes may be placed toward the second end of thefirst member.

In an embodiment, the second and third members may each include arespective conduit inside the members. Further, the second and thirdmembers may each include a number of through holes that extend from arespective surface of the second and third members to the conduittherein.

In an embodiment, a number of microphones may each be placed in arespective through hole of the first member. In one embodiment, a firstsubset of bidirectional microphones such as ribbon microphones may beplaced in the first subset of through holes of the first member; asecond subset of microphones may be placed in a second subset of throughholes of the first member.

Example Wearable Computing System Architectures

FIG. 2A illustrates a hearing assistance device 200 according to anembodiment of the disclosure. In one embodiment, the hearing assistancedevice 200 may be built around a pair of glasses 202 which may includeparts of the glass frame. In one embodiment, the glass frame may includerims 204, 206, sides 208, 210, hinges 212, 214 for connecting sides 208,210 to rims 204, 206, and a bridge 216 for connecting rims 204, 206.Rims 204, 206 may hold lenses so that the glasses 202 may function as avisual correction apparatus.

Additionally, hearing assistance device 200 may be built around glassframe 202. In one embodiment with details shown in FIGS. 2A and 2B, thehearing assistance device 200 may include a lead microphone 218, a lagmicrophone 220, a mouth microphone 222, a speaker 224, a tube extension226, an electronic circuit block 228, and a battery 230. The hearingassistance device 200 may further optionally include an ear bud orearphone 232. Lead microphone 218 and lag microphone 220 may be situatedon an inside surface of side 208. In one embodiment, lead microphone 218may be situated toward the front portion of side 208 near hinge 212, andlag microphone 220 may be situated toward the rear portion of side 208.Both lead microphone 218 and lag microphone 220 may be directionalmicrophones that are oriented toward front (i.e., in the direction ofeyesight). As lead microphone 218 and lag microphone 220 are situated onthe side of the user's head, they may receive sound such as speech fromthe direction of eyesight because the user's head may block sound fromside. Mouth microphone 222 may be situated on a lower portion of rim 204so that when the glasses are worn, the mouth microphone 222 would havebeen near the user mouth to capture sound from the user's mouth.

Microphones 218, 220, 222 may convert sound signals into electronicsignals and transmit the electronic signals to electronic circuit block228. In one embodiment, electronic circuit block 228 may be situated onside 210 toward the tip. Battery 230 may at a first end fit intoelectronic circuit block 228 and at a second end screw into hinge 214.Thus, the battery 230 may form part of side 210. In some embodiments,two batteries may be incorporated into the hearing assistance device 200and may form part of sides 208 and 210. In some embodiments, the twobatteries may be of different sizes to incorporate all of the componentsof the hearing assistance device.

In one embodiment, lead microphone 218, lag microphone 220, and mouthmicrophone 222 may be electrically connected to electronic circuit block228. In one embodiment, hinges 212, 214 may include circuit connectorsthat couple the microphones to the electronic circuit block 228 whensides are unfolded (or the glasses are in use). In one embodiment, theconnection is cut off when the sides are folded (or the glasses are notin use). Thus, the hinges 212, 214 may function as a switch of thehearing assistance device 200.

In one embodiment, speaker 224 may be coupled to electronic circuitblock 228 through a wire so that the user may have an option to placespeaker 224 adjacent to the earphone 232.

In one embodiment, for example as shown in FIG. 2A, hearing assistancedevice 200 may optionally include a universal serial bus (USB) port 238coupled to electronic circuit block 228. USB port 238 may be situated atthe tip of side 210. USB port 238 may function as an interface to otherdevices such as smart phones or portable electronic devices.

Example Earphones

In one embodiment, for example as shown in FIG. 2B, speaker 224 may besituated on side 210. Speaker 224 may include a metallic package and maybe coupled to a driver circuit in the electronic circuit block. Thus,sound signals (such as speech) received at microphones 218, 220, 222 maybe processed and transmitted by electronic circuit block 228 to thedrive circuit to drive speaker 224. In one embodiment, speaker 224 mayinclude a tongue on which a first end of extension tube 226 may fit on.

In one embodiment, for example as shown in FIG. 2B, extension tube 226may be flexible and composed of rubber or plastic. Extension tube 226may include a hollowed core. A first end of extension tube 226 may besealed by a first membrane, and a second end of extension tube 226 maybe sealed by a second membrane. The first and second membranes may bepassive radiator membrane that does not contain a voice coil or magnetassembly. The first end of extension tube 226 may include a ring magnetso that the first end may easily fit onto the tongue of the speaker 224.In one embodiment, the tongue of the speaker 224 may include an activedriver of the speaker. When the extension tube is plugged on to thetongue, the first membrane may be pressed against the active driver sothat the sound emitted from the speaker may be propagated through thetube to the second membrane. In one embodiment, the second end ofextension tube 226 may be detachably coupled to an ear bud 232 made fromsoft silicon. In a related embodiment, the second end of extension tube226 may be detachably coupled to an earclip with the ear bud 232attached to the earclip. Ear bud 232 may function as a passive noisesuppressor that may block environmental noise for the user of thehearing assistance device.

Since the extension tube 226 including the membrane and ear bud 232 aremuch cheaper than the speaker 224, extension tube 226 and ear bud 232may be replaced easily and with a significantly reduced cost. Further,since the microphones 218, 220, 222 are situated away from electroniccircuit block 228, the thermal noise generated by electronic circuitblock 228 does not mix into the microphone inputs. Moreover, the size ofbattery 230 is much larger and easier to replace than those built insidea hearing aid.

Example Capacitive Touch Sensitive Areas Including the “What” Button

Hearing assistance device 200 may further include sensors for receivingcontrol instructions from the user as shown in FIG. 2A. In oneembodiment, hearing assistance device 200 may include a first capacitivetouch sensitive area (also referred to as a “what” button) 234 situatedon side 208. The capacitive touch sensitive areas may be incorporatedinto the glasses frame, for example, on the outside of the side or armof the frame. First capacitive touch sensitive area 234 may beelectrically connected to electronic circuit block 228 include arecording logic which may continuously record the latest portion ofsound signals received at lead microphone 218 and lag microphone 220.For example, the recording logic may include a buffer that stores afixed period of sound signals just received at lead microphone 218 andlag microphone 220. The fixed time period may be five seconds, tenseconds, or any suitable period of time. Alternatively, the recordinglogic may detect breaks in received speeches and store in the buffer thelast speech. In the event that the user of hearing assistance device 200wants a repeat of whatever he just heard, the user may touch the button234 to activate a replay of the audio clip stored in the buffer. Thereplay may be transmitted to the ear of the user through speaker 224 andextension tube 226.

In one embodiment, hearing assistance device 200 may include other touchsensors for receiving instructions from the user. For example, hearingassistance device 200 may further include a second capacitive touchsensitive area 236 in the form of a slider so that user may slide-touchthe slider 236 to issue instructions. In one embodiment, the user maychange volume of the speaker 224 by sliding a finger that touches theslider 236. In some embodiments the capacitive touch sensitive areas Cof FIG. 2A may include more than one capacitive touch sensitive areassuch as a “what” button 234 and a slide-touch slider 236. The capacitivetouch sensitive areas may be incorporated into the design of the framesuch that the capacitive touch sensitive areas may not be immediatelyapparent to non-users. In embodiments, the capacitive touch sensitiveareas may be used to change functions or modes, for example, to switchbetween microphones or to activate Bluetooth® functionalities. Inembodiments, the capacitive touch sensitive areas may be used to accesscomputer readable instructions directing one or more computer processorsto perform electronic tasks. The computer processors may be embedded inthe frame or may be external to the hearing assistance device.

Example Cone Shape Interlocks/Connectors for Earphone Attachment

In some embodiments, the hearing assistance device may use an acoustic,wireless connection. In some embodiments, the speaker 224 is connectedto a flexible hollow tube 226 as depicted in FIG. 2C. In embodiments,the hollow tube may be an open-ended tube inserted into the inner ear ofthe human subject (user) to receive sound from the speaker. The amountof air in the hollow tube may fluctuate and may cause an echo effect. Insome embodiments, the passive radiator membrane 250, which is aflexible, thin membrane, may be used to remove the echo and to create anair seal at the end. In some embodiments, the hollow tube 226 with apassive radiator membrane 250 creates an air seal at the end may beconnected to an earphone. The earphone may act to hold the hollow tubein place and may block external sound. A sound/pressure wave may betransmitted from the speaker 224 in the glasses frame through the tubeto the user's ear. The change in air pressure in the flexible hollowtube 226 may move the passive radiator membrane 250. A female funnelshaped connection 240 in the glasses frame may be hollow and magneticand may be connected to the speaker 224. A male funnel shaped connection241 may be hollow and made of steel and may be attached to the end ofthe hollow tube 226. The male funnel shaped connector 241 attached tothe hollow tube may be magnetically attracted to the female funnelshaped connector 240 attached to the speaker 224 and may create a seal.

In some embodiments, the speaker is connected to an earphone 232 withone or more wires in a hollow tube 226. The earphone connection may be afemale funnel shaped connector 242 in the glasses as depicted in FIG.2C. The bottom half 243 of the female funnel shaped connector shown inorange may form an electrical connection to the speaker positiveterminal with a gap 244, for example, of 1 mm shown in purple, and thetop half 245 of the female funnel shaped connector shown in blue mayform an electrical connection to the speaker negative terminal. Thefemale funnel shaped connector 242 may contain a ring magnet, forexample, around the lip of the funnel. The female funnel shapedconnector 242 also may have spring-action copper tabs on the inner wallsof the connector for better electrical contact. For example, the femalefunnel 242 may have two or three spring-action copper tabs perconnector, and the spring-action copper tabs may have a configurationsimilar to a house phone charging and docking station. In embodiments,the earphone has a complementary male funnel shaped connector 246 and ismade of steel. The bottom half 247 of the male funnel shaped connectorshown in orange may form an electrical connection to the speakerpositive terminal with a gap 248, for example, of 1 mm shown in purple,and the top half 249 of the male funnel shaped connector shown in bluemay form an electrical connection to the speaker negative terminal. Inembodiments, the magnetic female funnel shaped connector 242 and themetal male funnel shaped connector 246 attract to form the necessaryelectrical connections. In some embodiments, the shapes of theconnectors are cone shaped. In embodiments, the funnel shapes havedimensions appropriate to fit the frame side 210, for example, 3 mmdiameter and 4 mm height (base to apex). In some embodiments, thespeaker wires may connect to a speaker 224. The speaker may be adjacentto an earphone 232.

Example V-Channel Interlocks/Connectors for Earbud Attachment

The V-channel interlocks/connectors for earbud attachment is a similarembodiment to the cone shaped interlocks/connectors for earphoneattachment. The V-channel connectors embodiment, the speaker isconnected to the same flexible hollow tube 226 as described for the coneshaped connector. As shown in FIG. 2M-1 through 2M-3, in the V-channelembodiment, an earbud 207 may be attached to an arching shaped earclip205, such as shown in 213, which may be positioned over the user's ear.The hollow tube 226 may be positioned inside the earclip 205 andattaches to the earbud 207 when the earbud 207 is secured at the bottomof the earclip. At the top of the earclip 205, a connector 203 may beposition on the earclip 205 by means of a ball joint, and attached tothe connector may be a male “V” shaped channel 211. An interlock strip201 with female “V” shaped hole 209 may be mounted on the glasses at 201where the ear meets the skull. The describe connector components may bemade of plastic with the copper or steel sheeting plates beneath. Thefemale “V” shaped hole 209 is lined with thin magnets which are strongenough to have a secure electrical contact, yet not so strong as todisconnect the earclip from the glasses or interfere with themicrophones. The male “V” shaped channel 211 fits into the female “V”shaped hole 209 and the thin magnets pull the connection tight and maycreate a seal to form the necessary electrical connections. Thesecomponents have dimensions appropriate to be comfortably worn by theuser and to fit the frame side, for example, a 9 mm earbud, 29 mmearclip, 12 mm earclip connector, 25 mm frame interlock strip, and 3.5mm male channel and female hole.

In some embodiments, an interlock strip with a female “V” shaped holemay be mounted on each arm of the glasses 201A, 201B. This embodimentmay allow earclips 205A and 205B to be positioned on both arms of theglasses. FIG. 2M-5 shows a right view of the glasses in some embodimentsof the invention. This view of the glasses shows interlock strip 201Apositioned on the right arm of the glasses with attached earclip 205A.The earclip 205A may be attached to the glasses by means of connector203A positioned on the earclip 205A. FIG. 2M-6 shows a left view of theglasses in some embodiments of the invention. This view of the glassesshows interlock strip 201B positioned on the left arm of the glasseswith attached earclip 205B. The earclip 205B may be attached to theglasses by means of connector 203B positioned on the earclip 205B. FIG.2M-7 shows a bottom view of the glasses in some embodiments of theinvention. This view of the glasses shows interlock strips 201A, 201Bpositioned on both arms of the glasses. In this figure, only earclip205B is shown attached by means of connector 203B to interlock strip201B on the left arm of the glasses. Earclip 205A may be similarlyattached by means of connector 203A to interlock strip 201A on the rightarm of the glasses.

FIG. 2M-4 shows an example earclip used in some embodiments of theinvention. On the earclip, both the V-channel connector positioned atthe top of the earclip and the earbud connector positioned at the bottomof the earclip may have tapered edges. This tapered edge design preventssharp edges on the earclip that may cause discomfort to the wearer. Theearclip may also include a ball joint that attaches the earbud connectorto the earclip to allow the earbud to better articulate and align withthe ear. The V-channel connector positioned at the top of the earclipmay also connect to the earclip by means of a ball joint. The V-channelconnector may be lined on the top with 0.15 mm copper sheetingsurrounding the “V” shaped channel and two holes to aid in securing theV-channel connector to the glasses. FIG. 2M-8 shows a right view of theglasses with attached earclip 205A in accordance with the earclipembodiment shown in FIG. 2M-4. This view shows an embodiment ofinterlock 201A positioned on the right arm of the glasses and earclip205A attached to interlock 201A by means of a streamlined embodiment ofconnector 203A positioned on the earclip 205A. This view shows a closedisplay of this earclip embodiment, including the tapered edge designand the ball joint attaching the earbud connector to the earclip.Similarly, FIG. 2M-9 shows a left view of the glasses with attachedearclip 205B in accordance with the earclip embodiment shown in FIG.2M-4. This view shows an embodiment of interlock 201B positioned on theleft arm of the glasses and earclip 205B attached to interlock 201B bymeans of a streamlined embodiment of connector 203B positioned on theearclip 205B. FIG. 2M-10 shows an isometric view of the glasses withattached earclips 205A, 205B in accordance with the earclip embodimentshown in FIG. 2M-4. FIG. 2M-11 shows a front view of the glasses withattached earclips 205A, 205B in accordance with the earclip embodimentshown in FIG. 2M-4. These views of the glasses show the positioning ofearclips 205A, 205B on both arms of the glasses from different angles.

Example Directional Velocity Ribbon Microphone

In one embodiment, hearing assistance device 200 may further include adirectional velocity ribbon microphone for capturing high-frequencydetails. In one embodiment, the directional velocity ribbon microphonemay be built into bridge 216 facing forward. FIG. 2D illustratescomposition of a directional velocity ribbon microphone 260 according toan embodiment of the disclosure. As shown in FIG. 2D, ribbon microphone260 may include a stack of filters 262 and a ribbon foil 264. Filtersmay be thin identical plates each including an array of holes that cutthrough the plates. Filters 262 may be places at equal spacing so thatair waves that are off axis (i.e., not in directions that directly facethe user) may be blocked by the stack of filters. However, air wavesaligned with axes of holes on these filters 262 may pass through withoutdegradation. A ribbon foil 264 may be attached to the stack of filtersfor sensing pressures from air waves. Ribbon foil 264 may include dimplepunch pattern and may be made from any type of materials suitable forconverting pressure into electronic signals. In one embodiment, Ribbonfoil 264 may be made from neodymium magnet foils. Ribbon foil 264 may beelectrically coupled to the electronic circuit block 228 for furtherprocessing the sound signals received at the ribbon microphone 260.

Example Side Frame Batteries

FIGS. 2E and 2F illustrate a hearing assistance device 200 according toother embodiments of the disclosure. In some embodiments, the hearingassistance device 200 may be built around a pair of glasses 202including rims 204, 206, sides 208, 210, hinges 212, 214 for connectingsides 208, 210 to rims 204, 206, and a bridge 216 for connecting rims204, 206. Rims 204, 206 may hold lenses so that the glasses 202 mayfunction as a visual correction apparatus.

In example embodiments with details shown in FIGS. 2E and 2F, thehearing assistance device 200 may include a lead microphone 218, a lagmicrophone 220, a mouth microphone 222, and an electronic circuit block228. In some embodiments, the hearing assistance device may includecapacitive touch sensitive areas 234 and 236. The hearing assistancedevice 200 may further optionally include an ear bud or earphone. Abattery may be magnetically attached to the frame, and the battery mayform part of side 210. In some embodiments, two batteries may beincorporated into the hearing assistance device 200 and may form part ofsides 208 and 210.

In some embodiments shown in FIG. 2E, the battery has a flat side withelectrical positive 281 and negative 283 contact points. In someembodiments, the electrical contact points on the battery may alsocorrespond to positive 284 and negative 282 magnets with the ability toattach to frame side 210 through magnetic attraction shown in FIG. 2E.The frame side 210 may have an electrical positive 286 and negative 288contact points that correspond to positive 285 and negative 287 magnets.The frame side 210 also may include an electrical barrier or gap 299.That is, in embodiments with a magnetically attached battery, theglasses frame has electrical positive 286 and negative 288 contactpoints that magnetically attract (through magnets on the battery at 282and 284 and magnets on the frame side at 285 and 287) battery electricalpositive 281 and negative 283 contact points, respectively, for correctelectrical connection.

In embodiments shown in FIG. 2E, the battery 280 is shaped like a barcut in half so that it corresponds to a half moon shape in a side view.The battery may also include two alignment features, for example,alignment protrusions 289 that will fit into corresponding alignmenttroughs 297 and 298 on the frame side 210. The alignment features mayprovide auto-alignment of the battery with the glasses frame.

In other embodiments shown in FIG. 2F, the battery 290 may have a steelflat underside with electrical positive 281 and negative 283 contactpoints. The frame side 210 may have an electrical positive 286 andnegative 288 contact points that correspond to magnets 291 and 292. Theframe side 210 also may include an electrical barrier or gap 299. Inembodiments, the magnets in the frame side may be used by the halleffect sensor near hinge 214 so that the glasses may be turned on byopening the glasses frames and may be turned off by closing or foldingthe glasses. In embodiments, the magnets 291 and 292 on the frame side210 may attract the steel battery 290. In embodiments with amagnetically attached battery, the glasses frame has electrical positive286 and negative 288 contact points that magnetically attract batteryelectrical positive 281 and negative 283 contact points, respectively,for correct electrical connection. In other embodiments, the battery mayhave a metallic underside that may be attracted to the frame side 210magnets 291 and 292. The battery may also include two alignmentfeatures, for example, alignment protrusions 289 that will fit intocorresponding alignment troughs 297 and 298 on the frame side 210. Insome embodiments, the frame side 210 is removable, and the battery 290may be magnetically attached to the frame side with magnets 291 and 292for charging, for example using a USB cable. In some embodiments, thecharging is assisted using alignment protrusions 289 on battery 290 thatfit into corresponding alignment troughs 297 and 298 on the frame side210.

In embodiments, the battery may come in various sizes such that theglasses frame containing other components does not change. For example,the battery 290 may be shaped like a bar cut in half so that itcorresponds to a half moon shape in a side view. For example, thestandard capacity and standard size battery 290 may be a 4 mm diametercylinder cut down the middle lengthwise to form a half circle. Anextended capacity battery 294 with a longer battery lifetime may be moreof the oblong shape when viewed from the side. A low capacity battery295 with a shorter battery lifetime may be shaped more like an oval whenviewed from the side. In some embodiments, the shape and size of thebattery may vary without changes to the glasses or glasses frame. Inexample embodiments, the user may choose a battery based on featuresincluding preference of weight and battery lifetime.

Embodiments of the hearing assistance device with the magnetic batterymay allow the user to change batteries very quickly and easily.Embodiments of the hearing assistance device with the magnetic batterymay allow the user to change the battery without removing the glasses orframe from the user's head. The battery 290 may have a mini USBconnector for recharging the battery when the battery is removed fromthe hearing assistance device. In some embodiments, the batteries may bemade in different styles or different colors and form part of the framedesign. The batteries may correspond to the length of the glasses framesides, for example, approximately 70 mm. The battery length combinedwith different styles or different colors of the battery may form partof the frame design.

Further Embodiments

In another speaker connect embodiment shown in FIG. 2G, the electricmicrophone capsule is the shape of a barrel, with an acoustic port slitlocated at the middle of the height of the barrel. The distance betweenthe slit and the top of the barrel creates a feedback point. Increasingor decreasing this distance increases or decreases the bass response. Inthis way, 2 tubes are provided that are the height of half the barrel.They can then slide to produce a tube that is from a half-barrel lengthto 1.5 barrel lengths. This provides tone control of the mic element bymechanically increasing or decreasing the tube length. The result isthat the mic preamp only receives the signal range in which it is tunedto, i.e. the electronics don't have to deal with an overloaded micsignal. This method is preferably used to process lower frequencysounds, but those are also the sounds that are most problematic for micoverloading.

FIGS. 2H, 2I, 2J, and 2K show example mockup images prototype boards andhow the prototype boards may be mounted on the glasses. FIG. 2H showshow a circuit board may be positioned on the right side of the frames toprovide features of the hearing assistant device. The circuit board mayinclude microphone components that may be positioned at the front of theframes near the lenses. The circuit board may also include mini jackcomponents to connect phones or other devices that may be positioned atthe back of the frames. FIG. 2H also shows the What button position onthe left side of the glasses. In some embodiments, sensors for takingphysiological and physical measurements may also be present on the armsor bridge of the glasses. FIG. 2I shows how a circuit board may bepositioned on the left side of the frames to provide features of thehearing assistant device. The circuit board for the left side mayinclude volume components that may be positioned at the back of theframes. The frame may also have an USB port connected to the circuitboard to provide input or output to/from the circuit board, and anon/off switch connected to the circuit board to disable electrical powerto the board. A battery may also be positioned on the left side of theframe, connected to the circuit, to provide electrical power to theboard. FIGs. provide examples of how the circuit components may bepositioned on the prototype boards to provide the features of thehearing assistant device. In FIG. 2L, composite sketches for anembodiment invention are provided. FIGS. 2L-1 through 2L-6 are enlargedillustrations of the composite sketches in FIG. 2L. In one embodiment,the height of the printed circuit boards may be reduced towards a goalof 10 mm or less along the length of the glasses arms, while creatingthe 3D mechanical files needed to print a pair of glasses to house thecircuit boards for the revision 2 prototypes. The size goal and batterydesign are all geared towards the goal of hiding the electronics inplain sight, so the glasses have an appearance of regular glasses. Theswitches shown may be optionally replaced with capacitive touchsensitive areas on the glasses frame. Preferably, the appearance is asmooth surface on the glasses, but if touched on certain areas they areeffectively control buttons to adjust functions such as volume up/down,hearing mode, phone call connect, what button, sensors for takingphysiological and physical measurements, etc.

FIGS. 2N-1 through 2N-8 show 3D mechanical drawings of the hearingassistance device glasses according to embodiments of the disclosure.FIG. 2N-1 shows a front view of the glasses to be worn on the head of auser in some embodiments of the invention. This view of the glassesshows a nose bridge 215 and nose guard 217 configured to be supported onthe nose of the user. A microphone, such as a ribbon microphone, may bepositioned near or on the nose bridge. FIG. 2N-2 shows a back view ofthe glasses in some embodiments of the invention. This view of theglasses shows volume control buttons 219 that may be positioned on theleft arm of the glasses. On the left side of the glasses, near thevolume control buttons 219, may also be positioned power control(on/off) buttons. FIG. 2N-3 shows an isometric view of the glasses insome embodiments of the invention. This view of the glasses shows a minijack connection positioned on the back right arm of the glasses toconnect phones or other devices that may be positioned at the back ofthe glasses. In some embodiments, the mini jack connection may be aBluetooth™ connection, a WiFi connection, or other such communicationlink. Some embodiments may also include a USB port positioned on theleft arm of the glasses for connecting to peripheral devices such asflash memory sticks, DVD/CD players, and printers.

FIG. 2N-4 shows a top view of the glasses to be worn on the head of auser in some embodiments of the invention. This view of the glassesshows cone shaped interlocks 221 which may be used by some wearers ofthe glasses for direct earbud attachment. FIG. 2N-5 shows a bottom viewof the glasses. This view of the glasses shows V-shaped interlocks 201which may also be used by some wearers of the glasses for earclip withattached earbuds attachment. FIG. 2N-6 shows another bottom view of theglasses in some embodiments of the invention. This view of the glassesshows a closer view of V-shaped interlocks, including a closer view ofthe magnets used to secure V-shaped connectors to the V-shapedinterlocks. FIG. 2N-7 shows a left view of the glasses in someembodiments of the invention. The view of the glasses shows thecapacitive touch sensitive area referred to as the “what” button 223that is present on both the right and left arm of the glasses. The“what” button 223 may be used to control functions of the glasses, suchas recording or playing an audio clip in memory on the glasses. In someembodiments, sensors for taking physiological and physical measurementsmay also be present on the arms or bridge of the glasses. FIG. 2N-8shows a right view of the glasses in some embodiments of the invention.This view of the glasses shows a closer view of the “what button,”volume controls, and V-shaped interlocks positioned on the glasses.

FIG. 2N-9 shows an exploded view of the glasses to be worn on the headof a user in some embodiments of the invention. This view of the glassesshows the frames that may include rims 204, 206, arm coverings 225,hinges 212, 214 for connecting arms to rims 204, 206, and a bridge 215for connecting rims 204, 206, and nose guard 217 configured to besupported on the nose of the user. The rims 204, 206 may hold lenses sothat the glasses may function as a visual correction apparatus. Theelectronics for the glasses may be contained inside the arm coverings225 of the glasses. The electronics may be configured to control leadmicrophone 218, lag microphone 220, and speaker 224B shown in the leftarm of the glasses, and may be further configured to control a ribbonmicrophone that may be positioned near or on the nose bridge in someembodiments. The electronics may also be configured to provide volumecontrol buttons 219 and power control (on/off) buttons positioned on theleft arm of the glasses, and “what buttons” 223 positioned on the frontof the glasses on both arms near the hinges 212, 214. In someembodiments, sensors for taking physiological and physical measurementsmay also be present on the arms or bridge of the glasses. Theelectronics may be powered by a battery 280 that fits into alignmenttroughs 297 on the left arm covering 225. This view of the glasses showsinterlock strip 201A positioned on the right arm of the glassesinterfacing with speaker 224A, and interlock strip 201B positioned onthe left arm of the glasses with interfacing with speaker 224B. Theearclips 205A, 205B may be attached to the glasses by means ofconnectors 203A, 203B respectively positioned on earclips 205A, 205B.This view of the device shows the earclip embodiment from FIG. 2M-4(with tapered edges and a ball joint attaching the earbud connector tothe earclip).

In another embodiment, a single flexible printed circuit board may beused in order to remove connectors and wires to save space and allow forhigher reliability, and to allow the glasses arms to be bent for fittingto the persons head.

Example System Diagram

FIG. 3 illustrates a system diagram of the hearing assistance deviceaccording to an embodiment of the disclosure. Referring to FIG. 3, ahearing assistance system 300 may include microphones 302.A-302.Z (suchas microphones 218, 220, 222 as shown in FIG. 2A and microphone 260 asshown in FIG. 2D), speakers 304.A, 304.B (such as speaker 224 as shownin FIG. 2A), and control input sensors 306.A-306.Z (such as touchsensors 234, 236 as shown in FIG. 2A). Hearing assistance system 300 mayfurther include processing device 330 for processing sound signalsreceived from microphones 302.A-302.Z, and output the processed soundsignals to speakers 304.A-304.B.

In one embodiment, processing device 330 may include a driver circuit308, a controller 310, a processing unit 312, a memory 314 (e.g.,read-only memory (ROM), flash memory, dynamic random access memory(DRAM) such as synchronous DRAM (SDRAM), etc.), a network interface 316,and power circuit 318, all of which may be interconnected through a bus320. Driver circuit 308 may be coupled to microphones 302.A-302.Z topre-amplify sound signals received from these microphones. Drivercircuit 308 may also be coupled to speaker 304.A, 304.B to drive thespeakers. Controller 310 may be a microcontroller unit (MCU) that is toreceive control inputs 306.A-306.Z to control a number of gainmultipliers. Processing unit 312 may enhance the received sound signalto be suitable for the user to listen to. For example, processing unit312 may suppress noise and enhance the speech component from a certaindirection. In one embodiment, processing unit 312 may enhance certainfrequency range of the received sound signal in view of the user'shearing deficiencies. Memory 314 may be a storage device to continuouslyrecord audio clips that may be replayed at user's instruction. Forexample, user may instruct the hearing assistance system through one ofsensors 306.A-306.Z to repeat last sentence heard. Audio contents storedin memory 314 may be selected, retrieved and played at this instruction.Network interface 316 may include wired and wireless connections toother devices. In one embodiment, network interface 314 may include aUBS interface through which external devices may communicate withhearing assistance system 300. In another embodiment, network interface316 may include a wireless connection such as a Bluetooth® connection.For example, in one embodiment, speakers 304.A, 304.B may be Bluetooth®speakers. Power circuit 318 may include a battery and circuitry tosupply electrical power to the hearing assistance system 300.

In operation, microphones 302.A-302.Z may receive sound signals (such asspeech). Hearing assistance system 300 may use the time delay betweensound or audio signals reaching a first and a second microphone to forma directional microphone. For example, a lead microphone may amplifypositive analog electronic signals, for example, of 1.0 while a lagmicrophone may amplify negative analog electronic signals, for example,of −0.6 leaving a signal of 0.4. A directional microphone may providesound signals with improved sound quality and less distortion. Forexample, sound signals received from the side of the hearing assistancesystem may cancel or zero out while sound received from the front of thehearing assistance system may be selectively amplified. Signalprocessing on electronic analog signals may be at the speed of light.

In operation, microphones 302.A-302.Z may receive sound signals (such asspeech) and convert the sound signals into electronic signals. Drivercircuit 308 may perform preprocessing on the electronic signals. In oneembodiment, the preprocessing may include pre-amplification and gainadjustment. In another embodiment, the driver circuit may includeanalog-to-digital converters (ADCs) to convert analog electronic signalsinto digital signals. Processing unit 312 may perform signal processingon the electronic signals. In one embodiment, processing unit 312 mayinclude hardware components to perform noise filtering, mono to stereoconversion, and signal normalization. In another embodiment, processingunit 312 may include a digital signal processor (DSP) that is configuredto perform noise filtering, mono to stereo conversion, and signalnormalization in the digitized sound signals. DSP conversion may lose ordistort time delay for directionality of analog signals. The DSP mayalso be configured to perform other functions including sentenceboundary detection and speech spectrum forming based on user's hearingprofile. The processing unit 312 may also include an accelerometer whichmay detect noise vibrations, such as the user's own voice or banging ofthe frames, and may further enhance frequency range of the receivedsound signal by mixing the sounds signals with the signals from theaccelerometer to reduce the volume of the noise vibrations in the soundsignals. The processing unit 312 may also receive instructions andsignals from other devices, such as mobile devices with an electronicinterface for controlling and monitoring the system, such as configuringgain adjustments. Driver circuit 308 may further include amplifiersand/or digital-to-analog converters (DACs) to play the processedelectronic signals on speakers 304.A, 304.B either as mono or stereoaudio. An earphone may be connected through respective channels toenable the user to hear the amplified representation of the audio signalin stereo.

The user of hearing assistance system 300 may issue commands to thesystem through sensors 306.A-306.Z. In one embodiment, the user maypress a touch button sensor to request a replay of last-heard sentence.In response to the request, controller 310 may retrieve from a buffer inmemory 314 the audio clip labeled as the last heard sentence and playthe retrieved audio clip. In another embodiment, the user may slide afinger on a strip of sensor to request an adjustment of volume. Inresponse to the request, controller 310 may change gains to the soundand thus adjust volume at speakers 304.A, 304.B.

Example Schematic

FIG. 4A illustrates a detailed schematic of the hearing assistancedevice embodiment 400. Referring to FIG. 4A, hearing assistance device400 may include lead microphone 402.A, lag microphone 402.B, and mouthmicrophone 402.C. Each of the microphones may convert received soundinto electronic signals. For example, microphones 402.A, 402.B mayconvert speech from others into electronic signals, and mouth microphone402.C may convert the user's speech into electronic signals. Each ofmicrophones 402.A-402.C may be coupled to a respective pre-amplifier 404to amply the electronic signals to an appropriate level. Additionally,each of the preamplifiers 404 may be coupled to a respective gainadjuster 406 that may variably adjust a gain to the electronic signalsunder the control of a microcontroller (MCU) 426. The electronic signalsfrom lag microphone 402.B may be inverted at inverter 408 (i.e., signalvalues are inverted) and is then mixed with electronic signals from leadmicrophone 402.A at signal mixer 410.A. Signal mixer 410.A may enhancespeech signal from the direction that the user faces and reduceincidental sounds from other directions.

A noise gate 412.A may further filter out noise (such as backgroundnoise) from the enhanced signal, and then a compressor 414.A may trackthe filter signals and create a track voltage for voltage controlledamplifier (VCA) which is part of the compressor 414.A. Compressor 414.Amay allow the hearing assistance device 400 to apply a high gain in theearlier stages (such as 404, 406) for optimal directional selection andnoise reduction, and then normalize before being played to the user.

The normalized audio signal may be again through a gain adjuster 406whose gain is controlled by MCU 426 and then the audio signal may berecorded in storage 416 for replay. Further, the normalized audio signalmay be converted from mono to stereo at converter 422.A and placed ontomixers 410.B, 410.C. Electronic signals from mouth microphone 402.C mayundergo similar processing through preamplifier 404, gain adjuster 406,noise gate 412.B, compressor 414.B, mono to stereo converter 422.B, andmixers 410.B, 410.C. The mixed audio signals may undergo further gainadjustment at gain adjuster 406, and left and right audio amplifications424.A, 424.B before being played out at speakers 430.A, 430.B.

In one embodiment, hearing assistance device 400 may include a touchbutton 418 through which the user may issue a replay command. Forexample, the user may be unsure about what he just heard. Instead ofasking for repeating from the speaker, the user may touch button 418(referred to as “What” or “what” button). Logic gate 480 may retrieveand play content stored in storage 416 in response to the activation ofthe “What” button. In some embodiments, the device further comprises a“what” button 418, wherein the “what” button 418 allows a user toretrieve and play the audio signal, e.g., repeat audio signal. The audiosignal may be stored in storage 416, which is an audio pipelineconstantly being filled like how a shift register handles bits. Forexample, the pipeline acts as a buffer and provides delayed audio signalas output when the pipeline is accessed with the “what” button. The“what” button may copy the output of the pipeline (delayed audio) intoFLASH whenever the user listens or accesses the pipeline audio signal.

In one embodiment, hearing assistance device 400 may further includeauxiliary audio input 432 and auxiliary audio output 434. In oneembodiment, auxiliary audio input 432 and auxiliary audio output 434 maybe wired so that other devices may be plugged in. In another embodiment,auxiliary audio input 432 and auxiliary audio output 434 may be wireless(such as Bluetooth® connections) so that other devices may communicatewith hearing assistance device according to a wireless standard. In someembodiments, the Bluetooth® interface allows a streaming audio or phoneconnection to the hearing assistance device 400. In some embodiments,the wireless standard uses a Wireless Fidelity (WiFi) interface tonetwork between the hearing assistance device and other devices. Forexample, a WiFi interface can be used for audio, video, and dataconnections, peer to peer, peer to group, remote microphones, remoteaudiologist evaluation, etc. In some embodiments, the Bluetooth® or WiFiconnections require most of the processing power of the hearingassistance device, and the user may not be able to receive audio signalwhile using these functionalities. In one embodiment, auxiliary audiooutput 434 may output audio signals from mouth microphone 402.C to anexternal device such as a cell phone. In one embodiment, an externaldevice such as a cell phone may input audio to the hearing assistancedevice 400 through auxiliary input 432. The audio input may be stereosignals that may be placed at mixers 410.B, 410.C and played out atspeakers 430.A, 430.B. In this way, the hearing assistance device 400may be interfaced with a cell phone.

Another Example Schematic

FIG. 4B illustrates a detailed schematic of the hearing assistancedevice embodiment 450. Referring to FIG. 4B, hearing assistance deviceembodiment 450 may include lead microphone 402A and lag microphone 402B.The embodiment may also include a mouth microphone, which is not shownin FIG. 4B. Each of the microphones may convert received sound intoaudio signals. For example, microphones 402A, 402B may convert speechfrom others into audio signals, and the mouth microphone may convert theuser's speech into audio signals. Microphones 402A and 402B may becoupled to variable gain adjusters 452 to increase or decrease theamplitude of the audio signals from the microphones under the control ofa microcontroller (MCU) 426. The sensitivity of microphones 402A and402B may be controlled by tuning the variable gain adjusters by means ofsignal SHT_MIC_LEAD_GAIN 460 for lead microphone 402A and by means ofsignal SHT_MIC_LAG_GAIN 462 for the lag microphone 402B. As shown inFIG. 4C, the user may be provided an electronic interface, such as on amobile phone, with a Lead Mic Sensitivity 484 option (e.g. slider) forcontrolling the SHT_MIC_LEAD_GAIN 460 signal and a Lag Mic Sensitivity485 option (e.g. slider) for controlling the SHT_MIC_LAG_GAIN 462signal. Once, adjusted for variable gains, the audio signals from thelag microphone 402B may be inverted at inverter 408 (i.e. signal valuesare inverted) and then summed with the audio signals from leadmicrophone 402 at SUM signal mixer 410.

The hearing assistance device embodiment 450 may also include anaccelerometer 446 to detect and reduce vibration noise. As the amplitudegains of the audio signals are increased, the hearing assistance devicemay be more sensitive to vibrations from various sources, including theuser's own voice or banging of the device glasses. The accelerometer 446may be placed at a location on the device, such as on the frames, themicrophones, the earbuds, or the headset, and may generate electronicsignals based on the linear output from detected vibrations. Theelectronic signals from the accelerometer may be used as controlsignals, which may first be adjusted for variable gain 452 and thenmixed with the summed audio signals at the Level Cut mixer to squelchthe vibrations from the summed electronic signals. By mixing theaccelerometer signals after summing the microphone signals, the devicein this embodiment preserves the pure audio from the microphones,instead of artificially adjusting the audio, as would result fromdirectly mixing the accelerometer signals with the output signals fromthe inverter 408, or cancelling the sound completely. Using thisembodiment, the accelerometer signal acts to fluctuate the volume (e.g.lower the volume) of only the source of the vibration. For example, ifthe vibration is caused by the user's own voice, only the sound of theuser's is lower, and the sound of other voices would not be affected. Inother embodiments, the accelerometer may be placed in another locationon the schematic to instead be used for cancellation of the audio fromthe vibration. In some embodiments, the user may be able to control thesensitivity of the accelerometer and the reduction in volume due to adetected vibration through an electronic interface.

A noise gate 412 may further filter out noise (such as background noise)from the enhanced signal, and then a compressor 414 may track the filtersignals and create a track voltage for voltage controlled amplifier(VCA) which is part of the compressor. In this embodiment, a separatenoise gate 412 may be used for the earbud microphone and the Bluetoothmicrophone input. The Bluetooth microphone input may first be adjustedfor variable gain 452 prior to being filtered at the noise gate 412. Thesensitivity of the noise filtering for the earbud microphone input maybe controlled by means of signal SHTGMIC_NOISEGATE 464, and thesensitivity of the noise filtering for the Bluetooth microphone inputmay be controlled by means of signal MTHMIC_NOISEGATE 472. As shown inFIG. 4C, the user may be provided an electronic interface, forcontrolling the SHTGMIC_NOISEGATE 464 and MTHMIC_NOISEGATE 470 signals.For example, as in FIG. 4C, the user may be provided with an Earbud MicNoisegate option (e.g. slider) 486 for controlling the SHTGMIC_NOISEGATE464 signal. A similar option may be provided to control theMTHMIC_NOISEGATE 470 signal.

Compressor 414 may allow the hearing assistance device 400 to apply ahigh gain in the earlier stages (such as 452) for optimal directionalselection and noise reduction, and then normalize through Expansion 456before being played to the user. The sensitivity of the compression forthe earbud microphone input may be controlled by means of signalSHTGMIC_COMPRESS 466, and the sensitivity of the compression for theBluetooth microphone input may be controlled by means of signalMTHMIC_COMPRESS 474. As shown in FIG. 4C, the user may be provided anelectronic interface, for controlling the SHTGMIC_COMPRESS 466 andMTHMIC_COMPRESS 474 signals. For example, as in FIG. 4C, the user may beprovided with an Earbud Mic Noisegate option (e.g. slider) 487 forcontrolling the SHTGMIC_COMPRESS 464 signal. A similar option may beprovided to control the MTHMIC_COMPRESS 474 signal.

Once normalized, in this embodiment, noise may be further reduced fromthe microphone signals at the Level Cut adjuster based on the earbud orBluetooth sensitivity. The earbud microphone sensitivity may becontrolled by means of the signal SHGN_MIC_MIX_LEVL 468, and theconfigured Bluetooth microphone sensitivity by means of the signalMOUTH_MIC_LEVEL 476. As shown in FIG. 4C, the user may be provided anelectronic interface, for controlling the SHGN_MIC_MIX_LEVL 468 andMOUTH_MIC_LEVEL 476 signals. For example, as in FIG. 4D, the user may beprovided with an Earbud Mic Sensitivity option (e.g. slider) 488 forcontrolling the SHGN_MIC_MIX_LEVL 468 signal. A similar option may beprovided to control the MOUTH_MIC_LEVEL 476 signal. Further, thenormalized audio signals may be converted from mono to stereo atconverter 422 and placed onto SUM signal mixers 410. In the case ofBluetooth input, the signals are first processed through a Bluetoothmodule and gain adjusters, prior to being placed onto SUM signal mixers.

The mixed audio signals may undergo further gain adjustment at gain AMPadjusters 458 before being played out at speakers 430A, 430B. The leftearbud volume may be controlled at the gain AMP by means of the signalMASTER_VOL_L_CS 478, and the right earbud volume may be controlled atthe gain AMP by means of the signal MASTER_VOL R_CS 480. As shown inFIG. 4E, the user may be provided an electronic interface, forcontrolling the MASTER_VOL_L_CS 478 and MASTER_VOL_R_CS 480 signals. Asin FIG. 4E, the user may be provided with an Earbud Volume Left option(e.g. slider) 492 for controlling the MASTER_VOL_L_CS 478 signal. Asfurther in FIG. 4E, the user may be provided with an Earbud Volume Rightoption (e.g. slider) 493 for controlling the MASTER_VOL_R_CS 480 signal.After making one or more adjustments using the provided signals, whethernot or not by means of the electronic interface, the user may use theelectronic device to save the settings. The settings may be saved to beused during a pre-determined activity, such as Home TV, Restaurant,Office, Train 490, or Phone Call 491. Other advanced option may also beavailable for tuning or configuring settings for the device 489.

The signals provides in this schematic, such as SHT_MIC_LEAD_GAIN 460,MTHMIC_NOISEGATE 470, MASTER_VOL_L_CS 478, and other such signalsdisplayed and not displayed on the schematic used to tune, control, ormonitor the device, may be provided as part of an applicationprogramming interface (API). This allows application developers, such asdevelopers of mobile device apps, and other software or hardwaredevelopers to create custom functions for tuning, controlling, ormonitoring the device, which may or may not be related to assistinghearing. The functions may be implemented using any program language andon any hardware or software platform or operating system. For example,an app developer may use the API to implement an app to monitor theaccelerometer signals to gather vibration data for purposes unrelated toassisted hearing, such as using the data as part of a jogging app torecord the number of miles ran.

Example Functions and Features

In some embodiments, the hearing assistance device may include atransceiver that can support singly or in combination any number ofwireless access technologies including Bluetooth®, WiFi, or other shortor long range communication protocols. For example, wireless access fornetworking, allows the hearing assistance device to make connections foraudio, video, and data input, peer to peer communications, peer to groupcommunications, remote microphones, and remote audiologist evaluation.Using these connections, the hearing assistance device acts as its ownplatform that may interact broadly with software applications orprograms on communication device, such as smartphones, tablets,conventional telephones, personal computers, Bluetooth devices, WiFidevices, or any other device that supports internet access. For example,a smartphone app, such as Siri, may be controlled directly from thehearing assistance device. Further, the hearing assistance device maysupport its own electronic interface that may be configured as asoftware application on a communication device (e.g., smartphone ortablet) that allow tuning, controlling, or monitoring the hearingassistance device. The device also includes an application programminginterface (API) such that application developers, such as developers ofmobile device apps, and other software or hardware developers may createcustom functions for tuning, controlling, or monitoring the device,which may or may not be related to assisting hearing.

Furthermore, the hearing assistance device may include an intercom modewhich allows two or more users of the device to communicate with eachother using Bluetooth®, WiFi, or other short or long range communicationprotocols. In intercom mode, the devices may be used similar to awalkie-talkie, such that the first user of a first device may initiate aconversation with the second user of a second device, wherein the firstdevice may be set to Bluetooth® source mode to transmit the first user'svoice to the second device. The second device in Bluetooth® sync modemay receive the first user's voice communication in the same manner thatthe device would receive communications from any other Bluetooth® paireddevice. The second user may then respond to the first user, wherein nowthe second device may be set to Bluetooth® source mode to transmit thesecond user's voice to the second device which will receive the voicecommunication in Bluetooth® sync mode.

In one embodiment, hearing assistance device 400 may include a battery428 that supplies power to the device. MCU 426 may be coupled to a USBport 438 for connecting to peripheral devices such as flash memorysticks, DVD/CD players, and printers. MCU 426 may include FLASH Memory448 to continuously record audio clips that may be replayed at user'sinstruction. MCU 426 may also be coupled to a tuning word 436 which maydetermine a state under which hearing assistance device 400 operates.For example, MCU 426 may read tuning word 436 and set gains in thehearing assistance device 400 embodiment according to it. For anotherexample, MCU 426 may read tuning words (i.e. signal) SHT_MIC_LEAD_GAINto set gains in Lead Mic Sensitivity 460, SHT_MIC_LAG_GAIN to set gainsin Lag Mic Sensitivity 462, or other such tuning words to set gainsaccordingly in the hearing assistance device 450 embodiment. Hearingassistance device 400 may operate under different presets such as “inhome,” “telephone conversation,” “outdoor,” “concert hall,” “sportingarena,” etc., as shown in FIG. 4E, 490. Each of these presents may beencoded in a particular tuning word that may cause MCU 426 to set thegains of gain adjusters 406 to be optimal for that scenario. The MCU 426may include sensors to control these presets 426. In one embodiment,tuning words may be stored as static RAM or FLASH Memory 448 selectableby the user using touch sensors (such as those 306.A-306.Z as shown inFIG. 3). Moreover, hearing assistance device 400 may include sensors 440to control volume. In response to user's request to change volume, MCU426 may gains at gain adjusters 406 to adjust volume at speakers 430.A,430.B. In some embodiments, the hearing assistance device may include apiece or a component for bone conduction of sound or audio signal. Forexample, the hearing assistance device may include a check bone areaconnection, which can be useful for users with outer or middle earissues.

In some embodiments, sound signals or audio signal received by atransducer is converted to physical vibrations or as vibrationsexperienced by the user through sense of touch. For example, thephysical vibrations may be experienced by the user on a temple or eararea. In embodiments, conversion of audio signal by the transducer tovibrations occurs in a range “felt” or experienced by a deaf userthrough sense of touch so that a deaf user could sense sound. In someembodiments, a pitch shift of the sound frequencies of the audio signalto lower frequencies and a compression of the frequency range allows auser to sense sound through vibrations.

In some embodiments, sounds or signals may be displayed as a 3Dspectrogram of audio to devices in communication with the hearingassistance device, such as a mobile phone or personal computer. The usermay then be able to see the shape of sounds, and may be able torecognize particular words and sounds based on the shape. In addition,the hearing assistance device may use these shapes to determine theparticular pitch and frequencies of the speech at any given interval(e.g. based on the displayed peaks and valleys on the spectrogram) priorto the user hearing the speech. Then, the device may automaticallyenhance the particular pitch and frequencies at each interval accordingto the user's deficiencies or in other manners that enhance the brain'sability to process the speech using equipment such a multi-band variableparametric EQ. The speech is then transmitted to the user in theenhanced format in real-time or with minimal delay.

In some embodiments, the hearing assistance device may also includevision assistance features. An ultrasound device may be mounted to theframes of the glasses to send a signal to measure the distance toobjects in front or around the user. The hearing assistance device maythen use the measurements reported from the ultrasound to generate atone based on the distance from the objects. The user may hear the tonein his/her headphones or earbud and know how close he/she is from theobjects. For example, the ultrasound device may measure a boulder twentyfeet in front of the user, so the hearing assistance device may generatea low tone, but as the ultrasound device measures that the user movescloser to the boulder, the hearing assistance device may generate anincrementally louder tone.

In some embodiments, the hearing assistance device includes a componentusing a method to pitch shift an audio signal such that the originalpitch of an audio signal is raised or lowered. In some embodiments, atransducer uses a method to pitch shift an audio signal. In exampleembodiments, the pitch shifting method allows a user to hear sounds(emitted and optionally amplified audio signals) normally outside of thedetectable frequency range of the inner ear by shifting the input audiospectrum or signal. In other embodiments, the pitch shifting methodallows a user to hear sounds (emitted and optionally amplified audiosignals) normally outside of the detectable frequency range of humanhearing by shifting the input audio spectrum or signal. For example, auser could listen to audio signal in the 50 kHz frequency range when apitch shifting method of shifting audio signal down by one-tenth suchthat an audio signal of 5 kHz is emitted allowing for detection ofbearing problems in a jet engine.

In some embodiments, a transducer of the hearing assistance deviceapplies a method to allow a user to perceive frequencies or an audiosignal via psychoacoustics. Psychoacoustics refers to the study of theperception of sound.

In some embodiments, the hearing assistance device may include a pieceor a component to monitor vital signs. For example, vital signs includeheartbeat, skin resistance, blood oxygen saturation, and blood pressure.In embodiments, the hearing assistance device may include a temple areaconnection to monitor vital signs. In some embodiments, monitoring vitalsigns is a result of the user touching a capacitive touch sensitive areaon the frames. In some embodiments, this function can be controlled bygestures. In some embodiments, monitoring vital signs may triggercommunication through, for example, Bluetooth™ or WiFi with the user.For example, a user may be exercising, e.g., running, while the systemmonitors heart rate and temperature. In some embodiments, the monitoringof vital signs is activated based on a shock or vibration detection bythe device, for example, as a result of the user falling.

In embodiments, the hearing assistance device may include a piece or acomponent to provide an audio hearing range testing. In someembodiments, the results of the audio hearing range testing allows foradjustment. In some embodiments, the audio hearing range testing is ofthe user of the hearing assistance device. In some embodiments, theaudio hearing range testing with optional adjustment is provided by atuning board or an application on a device such as a mobile phone,tablet, or computer. In some embodiments, the hearing assistance devicefurther comprises an external tuning board with buttons. In exampleembodiments, the tuning board is small, for example a 1.5 inch by 3 inchboard with buttons. For example, see FIGS. 5B, 5C, and 5D.

In some embodiments, the device may use speech recognition to enhancethe speech. In such embodiments, a microphone receives an audio signalof speech by an individual in proximity to the user or source. Themicrophone is connected to a converter or a transducer that converts thefirst audio signal to a first digital representation of the first audiosignal. The digital representation may be enhanced by converting in amanner to remove all noise besides the individual's speech. Then acontroller may be configured to perform speech recognition of the firstdigital representation of the audio signal, in which the first digitalrepresentation is translated to text and all remaining noise notrecognized as the individual's speech is removed during the translation.The controller may be configured to also convert the text to a seconddigital representation and convert the second digital representation toa second audio signal in a different pitch and frequency than the firstaudio signal (i.e. new speech), which is output to the user through theheadset or ear bud. The new generated speech may be output to the useras a different human voice or modulated voice that is easier for theuser to hear than the original speech. In some embodiments, thecontroller may completely remove non-speech noise from the speech heardby the user. In the same or different embodiments, the controller may beconfigured to amplify the audio signal at a low volume, and thenincrease the amplification when certain words or phrases are detected,which may aid in the user's ability to filter speech in varioussituations (e.g. noisy or chaotic situations).

In some embodiments, the hearing assistance device may include acomponent to provide language translation. In an embodiment, amicrophone receives an audio signal of speech of a first language spokenby an individual in proximity to the user or source. The microphone isconnected to a converter or a transducer that converts the audio signalto a digital representation of the audio signal. In some embodiments,the audio signal may be converted from the digital representation totextual representation, as described above. If not converted to text,the digital representation may be otherwise enhanced by converting it ina manner to remove or reduce all noise besides the words of the speaker,such as background noise, or this noise may be filtered out after theconversion. The digital representation may also be enhanced according tothe users/listeners deficiencies, such as adjusting the pitch orfrequency during the conversion or filtering process. The backgroundnoise may also have been similarly enhanced earlier in the process fromthe audio signal before the conversion.

A controller processes and compares the digital or textualrepresentation of the audio signal to a language table stored in memoryor storage to convert the digital or textual representation to a seconddigital or textual representation. This second digital or textualrepresentation of the audio signal is a translation of the firstlanguage into a second language. The controller converts the seconddigital or textual representation of the audio signal (or may firstconvert the textual representation to the digital representation) to avoice modulated audio signal of the second language. The controllercontrols as speaker (an ear bud in some examples) which outputs or emitsthe voice modulated audio signal of the second language to the wearer sothe wearer can understand the speech of the first language and hear thetranslation in a voice modulated manner. In embodiments where the speechwas enhanced (e.g. removed background noise, improve pitch, improvefrequency), the translation may now not only provide the translation forthe user, but the translation is presented to the user as new generatedspeech (using a different human voice or modulated voice) that is easierfor the user to hear than the original speech. For example, German isspoken by an individual in proximity to the hearing assistance deviceand is the audio signal of speech of a first language. Then, forexample, the user wearing the hearing assistance device hears theemitted audio signal in English, the second language, and as new speechmore audible than the original spoken words. In some embodiments, two ormore users, conversing in two or more different languages, may each hearthe speech from the other users in that respective user's own native orchosen language, and may communicate back to the other users in thatrespective user's own native or chosen language.

As part of this process, the device may utilize speech recognition,dictation, or language translation software (e.g. Dragon) installed onthe device frames or on another device that communicates with thedevice, such as a mobile phone, to perform some or all of the speechconversion. In embodiments where the audio is converted to textualrepresentation, the text may also be visually displayed to the user orothers, on other devices communicating with the hearing assistancedevice, such as a mobile phone or laptop, or on the lens of the glasses.

A device that may include at least one first transducer for receivingsound signals, at least one second transducer for emitting soundsignals, and at least one extension tube coupled to the at least onesecond transducer, in which the at least one extension tube may includea hollowed core from a first end to a second end of the at least onetube.

Example Circuit Boards

FIG. 5A illustrates an example embodiment of circuit boards 500 and 520(not to scale) for the hearing assistance device. The circuit board 500may represent the circuit board of the right side of the glasses frame.For example, circuit board 500 may provide circuitry connectionsincluding microphone connections 510, 512, 514 to microphones 218, 220,222 and a mini jack connection 516 to a device such as a phone. Thecircuit board 520 may represent the circuit board of the left side ofthe glasses frame. For example, circuit board 520 may provide circuitryconnections including volume controls 522, power control 524 (on/off),USB connection 526, and battery 528. In some embodiments, themicrocontroller unit (MCU) and battery circuits, which convert thebattery to needed voltages for components, may be located on one side ofthe glasses frame while microphones may be located on the other side orarm of the glasses frame. In embodiments, the components are placed suchthat noisy components such as the MCU and the battery circuits do notinterfere or create background noise that is picked up by themicrophones. In some embodiments, the actual scale of the circuit boardwill fit within the frame or glasses frame of the hearing assistancedevice.

In some embodiments, the circuit board uses standard componentsincluding, but not limited to, 9-pin connectors, 10-pin connectors, pushbuttons, 0.5 mm pitch cables, and 0.3 mm cables. For example, FIG. 5Billustrates an example embodiment of circuit boards 530 and 540 (not toscale) for the hearing assistance device. The circuit board 530 mayrepresent the circuit board of the right side of the glasses frame. Forexample, circuit board 530 may provide circuitry connections includingmicrophone connections 540, 542, 544 to microphones 218, 220, 222 and amini jack connection 546 to a device such as a phone. In someembodiments, the communication connection may be a mini jack connection,a Bluetooth™ connection, a WiFi connection, or other communication link.The circuit board 530 may represent the circuit board of the left sideof the glasses frame. In some embodiments, the hearing assistance devicemay also include a “what” button circuit board 550 with a “what” buttoncircuit power switch 552 (on/off). For example, circuit board 560 mayprovide circuitry connections including volume controls 562, powercontrol 564 (on/off), USB connection 566, and battery 568. In someembodiments, a connection including a USB connection, a Bluetooth™connection, or a Wi-Fi connection may be integrated into the circuitboard to connect to a device such as a phone or a computer, for example,to upgrade or update software. In some embodiments, sensors for takingphysiological and physical measurements may also be present on the armsor bridge of the glasses. In some embodiments, the actual scale of thecircuit board will fit within the frame or glasses frame of the hearingassistance device.

FIG. 5C shows embodiments of the front side of circuit boards for thehearing assistance device and accessories using standard components. Forexample, left side circuit board 560 showing volume controls 562, powercontrol 564 (on/off), USB connection 566, and battery 568, “what” buttoncircuit board 550 with power switch 552, and right side circuit board530 showing microphone connections 540, 542, 544 to microphones 218,220, 222 and a mini jack connection 546 to a device such as a phone asdepicted in FIG. 5B. FIG. 5C also shows an embodiment of an externaltuning board to adjust and calibrate the settings of the hearingassistance device. The tuning board may be a physical external componentor device or an application, for example, on a mobile phone, laptop orcomputer. The tuning board may allow a user to fine tune microphones,levels, preset modes such as “Restaurant,” “Car,” and “Theater.” In someembodiments, a mobile phone or other device may let the hearingassistance device know the user's location, for example, detecting theuser has walked into a theater, a restaurant, or a sports arena, oraction, for example, answering a phone call, and may automaticallychange the hearing assistance device to an appropriate preset mode. Inother embodiments, the hearing assistance device may detect the locationor action directly, without the use of another device, and mayautomatically change to an appropriate preset mode.

FIG. 5D shows embodiments of the back sides circuit boards for thehearing assistance device using standard components as depicted in FIG.5B. For example, left side circuit board 560 showing volume controls562, power control 564 (on/off), USB connection 566, and battery 568,“what” button circuit board 550 with power switch 552, and right sidecircuit board 530 showing microphone connections 540, 542, 544 tomicrophones 218, 220, 222 and a mini jack connection 546 to a devicesuch as a phone as depicted in FIG. 5B. FIG. 5C also shows an embodimentof an external tuning board to adjust and calibrate the settings of thehearing assistance device.

In some embodiments, the circuit board may be printed. For example, theprinted circuit board may have a height of 10 mm or less with a lengthcompatible with the glasses arms. In some embodiments, the circuit boardwill be free of standard components such as connectors and wires toreduce bulk and to provide higher reliability. In some embodiments, theprinted circuit boards of the glasses arms may be bent to fit and adjustto a user's head. In some embodiments, three dimensional mechanicalfiles may be used to print a pair of glasses to house the circuit boardsof the hearing assistance device. In some embodiments, the printedcircuit board will be a single flexible printed circuit board. Inembodiments, the electronics are hidden in plain sight, and the hearingassistance device has the appearance of regular glasses.

In embodiments, the circuit board allows the hearing assistance deviceto perform multiple functions including, but not limited to, convertingsound signals into electronic signals; transmitting the electronicsignals to electronic circuit block; connecting or switchingmicrophones, e.g., lead microphone 218, lag microphone 220, and mouthmicrophone 222, to electronic circuit block; transmitting electronicsignals for a functioning “what” button to repeat audio signal;adjusting volume; changing hearing mode; and transmitting electronicsignals to allow monitoring of vital signs.

In some embodiments, the switches and buttons shown may be replaced withcapacitive touch sensitive areas on the glasses frame. The hearingassistance device will have the appearance of glasses frames withoutbuttons, for example, smooth or designs such as stripes that allow thehearing assistance device to perform multiple functions. The hearingassistance device if touched on certain areas may effectively correspondto control buttons to adjust functions including, but not limited to,volume adjustment, hearing mode, phone call connect, “what” button,switch between microphones, and monitor vital signs. One of skill in theart appreciates that as technology for transmitting electronic signalsimproves and changes, embodiments of the hearing assistance device mayincorporate new technology.

Example Components

Example 1 is a device that may include at least one first transducer forreceiving sound signals, at least one second transducer for emittingsound signals, and at least one extension tube coupled to the at leastone second transducer, in which the at least one extension tube mayinclude a hollowed core from a first end to a second end of the at leastone tube.

In Example 2, the subject matter of Example 1 can optionally providethat the first end of the at least one extension tube is sealed with afirst membrane, and the second end of the at least one extension tube issealed with a second membrane.

In Examiner 3, the subject matter of Example 1 can optionally providethat the hollowed core of the at least one extension tube contains inertgases including air, noble gases, and nitrogen.

In Example 4, the subject matter of Example 1 can optionally providethat the device may be wearable by a human subject.

In Example 5, the subject matter of Example 4 can optionally providethat the device may be mounted on human head in the form of a glassframe, in which the glass frame may include two rims to hold glasses,two sides each coupled to one rims, and a bridge that connects the tworims.

In Example 6, the subject matter of Example 5 can optionally providethat the at least one first transducer may include a lead microphone anda lag microphone where the lead microphone is arranged to be situated ata front portion of one side of the glass frame and the lag is arrangedto be situated at a rear portion of the side.

In Example 7, the subject matter of Example 6 can optionally providethat lead microphone and the lag microphone may be directionalmicrophones that are oriented toward front to receive sound input from aparticular direction.

In Example 8, the subject matter of Example 7 can optionally providethat the at least one first transducer may include a third microphonethat may be arranged to be situated on one rim of the glass frame belowthe bridge and that may be oriented toward below for capturing soundfrom the mouth of the human subject.

In Example 9, the subject matter of Example 8 can optionally providethat the at least one second transducer may include a speaker that maybe arranged to be situated toward the tip of the side of the glassframe, and that speaker may include a tongue on which the first end ofthe extension tube is coupled to.

In Example 10, the subject matter of Example 9 can optionally providethat when coupled to the tongue, the first membrane at the first end ofthe extension tube may be pressed against the tongue, and that thesecond end of the extension tube may be inserted into the inner ear ofthe human subject to receive sound from the speaker.

In Example 11, the subject matter of Example 10 can further include anelectronic circuit coupled to the microphones and the speaker, in whichthe electronic circuit may convert sound signals received at themicrophones into electronic signals, suppress noise, selectively amplifyuseful sound signals, and output the cleaned and amplified sound to thespeaker, and in which the electronic circuit may be embedded in one sideof the glass frame.

In Example 12, the subject matter of Example 11 can further include abattery to supply powers to the electronic circuit, in which a shape ofthe battery is a tube that may constitute part of the side of the glassframe, and in which the electronic circuit and the battery is on a firstside of the glass frame, and the front microphone, lag microphone, andthe speaker is on a second side of the glass frame.

In Example 13, the subject matter of Example 12 can further include anumber of touch sensors on the sides of the glass frame to receiveinstructions from the user. The touch sensors may be coupled to theelectronic circuit which is to perform the functions of the instruction,in which the device may include a touch button which, when activated bypushing the button, is to cause an audio clip to be replayed.

In Example 14, a hearing assistance device comprises a frame configuredto be worn on the head of a user, the frame including a bridgeconfigured to be supported on the nose of the user; a first transducerwith two microphones on the right side of the frame and a thirdmicrophone near the nose bridge and a second transducer for emittingamplified audio signals including a wired speaker, such as an ear bud,which is connected to the frame.

In Example 15, a hearing assistance device comprises a frame configuredto be worn on the head of a user, the frame including a bridgeconfigured to be supported on the nose of the user; a first transducerwith two microphones on the right side of the frame and a thirdmicrophone near the nose bridge and a second transducer for emittingamplified audio signals including a speaker using a flexible tube, suchas an ear bud, which is connected to the frame.

In Example 16, a hearing assistance device comprises a frame configuredto be worn on the head of a user, the frame including a bridgeconfigured to be supported on the nose of the user; a first transducerwith one ribbon microphone on the nose bridge and a second microphonenear the nose bridge and a second transducer for emitting amplifiedaudio signals including a wired speaker, such as an ear bud, which isconnected to the frame.

In Example 17, a hearing assistance device comprises a frame configuredto be worn on the head of a user, the frame including a bridgeconfigured to be supported on the nose of the user; a first transducerwith one ribbon microphone on the (nose) bridge of the frame and asecond microphone near the nose bridge and a second transducer foremitting amplified audio signals including a speaker using a flexibletube, such as an ear bud, which is connected to the frame.

Digital Processing Environment

Example implementations of the present invention may be implemented in asoftware, firmware, or hardware environment. FIG. 6A illustrates onesuch environment. Client computer(s)/devices 650 (e.g., mobile phone orhearing assistance device) and a cloud 660 (or server computer orcluster thereof) provide processing, storage, and input/output devicesexecuting application programs and the like.

Client computer(s)/devices 650 can also be linked through communicationsnetwork 670 to other computing devices, including other clientdevices/processes 650 and server computer(s) 660. Communications network670 can be part of a remote access network, a global network (e.g., theInternet), a worldwide collection of computers, Local area or Wide areanetworks, and gateways that currently use respective protocols (TCP/IP,Bluetooth®, etc.) to communicate with one another. Other electronicdevice/computer network architectures are suitable.

Embodiments of the invention may include means for displaying audio,video, or data signal information. FIG. 6B is a diagram of the internalstructure of a computer/computing node (e.g., clientprocessor/device/mobile phone device/tablet 650 or server computers 660)in the processing environment of FIG. 6A, which may be used tofacilitate displaying such audio, video, or data signal information.Each computer 650, 660 contains a system bus 679, where a bus is a setof actual or virtual hardware lines used for data transfer among thecomponents of a computer or processing system. Bus 679 is essentially ashared conduit that connects different elements of a computer system(e.g., processor, disk storage, memory, input/output ports, etc.) thatenables the transfer of data between the elements. Attached to systembus 679 is I/O device interface 682 for connecting various input andoutput devices (e.g., keyboard, mouse, displays, printers, speakers,etc.) to the computer 650, 660. Network interface 686 allows thecomputer to connect to various other devices attached to a network (forexample the network illustrated at 670 of FIG. 6A). Memory 690 providesvolatile storage for computer software instructions 692 and data 694used to implement a software implementation of the present invention(e.g. hearing assistance system). If implemented in software, computingcomponents (e.g. mobile computing components) that interface with thehearing assistance device described herein may be configured using anyknown programming language, such as any high-level, object-orientedprogramming language. In one example, a software implementation for OS Xand iOS operating systems and their respective APIs, Cocoa and CocoaTouch maybe implemented using Objective-C or any other high-levelprogramming language that adds Smalltalk-style messaging to the Cprogramming language.

Disk storage 696 provides non-volatile storage for computer softwareinstructions 698 (equivalently “OS program”) and data 694 used toimplement and data 695 stored by embodiments of the hearing assistancesystem of the present invention. Central processor unit 684 is alsoattached to system bus 679 and provides for the execution of computerinstructions. Note that throughout the present text, “computer softwareinstructions” and “OS program” are equivalent.

In one example, a computing device may be configured with computerreadable instructions 694 to provide a tuning application to enablevolume and equalization optimization to the earphones, which providehearing assistance, using the inventive frames of the invention hearingassistance system.

In another example, a mobile device may interface with the inventiveframes of the invention hearing assistance system using a spiraltimeline interface to display and control data (e.g. audio or videodata) recorded and/or processed by the computing components embodied inthe frames of the present invention hearing assistance system. Such anspiral timeline interface, preferably, displays new audio, video, ordata, without compressing the visual of the timeline (or portionsthereof), and includes the features of the spiral timeline interfacedisclosed in U.S. application Ser. No. 14/152,671, “Multimedia SpiralTimeline” by Wayne D. Boyle and Peter J. Sprague, filed on Jan. 10,2014, the entire teachings of which are incorporated herein byreference.

Aspects of the invention hearing assistance system may be implementedusing any device or system (computer/device 650, 660) capable ofrecording or processing an audio, video, or data input file. Optionally,a retroactive recording system using features disclosed in U.S. Pat. No.6,072,645, “Method and apparatus for retroactive recording using memoryof past information in a data storage buffer,” filed Jan. 26, 1998, theentire teachings of which are incorporated herein by reference, forexample, may be implemented using the spiral timeline. In an examplemobile implementation, if a retroactive recording application isexecuted, the system may be configured to using a loop recorderimplementation in which, upon execution, it automatically startsrecording audio, video, or data content and stores the incoming inputstream to a temporary storage location (cache). If the application isexited from or shut down, the input stream may be discarded. If the userexecutes the application again, it would automatically begin a newrecording. If a user indicates that segment(s) of the input streamshould be permanently recorded, then those segment(s) may be stored to apermanent storage location shown on the spiral timeline in a differentcolor shade or using a transparency overlay on the respective portion ofthe spiral timeline (or shown in any other way capable ofdifferentiating the recorded portions stored to temporary memory fromthose portions stored in permanent memory). In this way, the spiraltimeline can be used to help easily distinguish portions of an inputsignal that are stored in temporary storage verses those portions thatare stored in permanent storage.

In one embodiment, the processor routines 692 and data 694 are acomputer program product, display engine (generally referenced 692),including a computer readable medium capable of being stored on astorage device 696, which provides at least a portion of the softwareinstructions for the spiral timeline invention system.

In other embodiments, the processor may be configured with a real-timetranslation, dictation, or speech recognition computer program product692. In one embodiment, as the microphone in the glasses records speechspoken in another language, real-time translation software may beprovided so that the speech is translated and transmitted to theuser/listener's earphone in the language of the user/listener. Inanother embodiment, as the microphone in glasses record speech,real-time dictation software may be provided to convert the speech totext for display or further communication. The processor using a same ordifferent computer program may convert the text to new speech (e.g.different human voice or modulated voice) that is easier for the user tohear than the original speech). The new speech may be enhanced accordingto the deficit of the user, such that the pitch, frequency, or othersuch characteristic is more suitable to the particular user.

The computer program product 692 can be installed by any suitablesoftware installation procedure, as is well known in the art. In anotherembodiment, at least a portion of the spiral timeline softwareinstructions may also be downloaded over a cable, communication and/orwireless connection. In other embodiments, the invention hearingassistance system software is a computer program propagated signalproduct 607 embodied on a propagated signal on a propagation medium(e.g., a radio wave, an infrared wave, a laser wave, a sound wave, or anelectrical wave propagated over a global network such as the Internet,or other network(s)). Such carrier medium or signals provide at least aportion of the software instructions for the present spiral timelineinvention routines/program 692.

In alternate embodiments, the propagated signal is an analog carrierwave or digital signal carried on the propagated medium. For example,the propagated signal may be a digitized signal propagated over a globalnetwork (e.g., the Internet), a telecommunications network, or othernetwork. In one embodiment, the propagated signal is transmitted overthe propagation medium over a period of time, such as the instructionsfor a software application sent in packets over a network over a periodof milliseconds, seconds, minutes, or longer. In another embodiment, thecomputer readable medium of computer program product 692 is apropagation medium that the computer system 650 may receive and read,such as by receiving the propagation medium and identifying a propagatedsignal embodied in the propagation medium, as described above forcomputer program propagated signal product.

While this invention has been particularly shown and described withreferences to example embodiments thereof, it will be understood bythose skilled in the art that various changes in form and details may bemade therein without departing from the scope of the inventionencompassed by the appended claims.

1. A hearing system that protects from damaging noise, the hearing system comprising: a frame configured to be worn on the head of a user; a first transducer coupled to the frame, the first transducer including at least two microphones configured to receive an audio signal; a converter configured to convert and to amplify the audio signal to an amplified representation of the audio signal, wherein the converter is configured to adjust the audio signal to an audio level non-damaging to hearing functions of the user; and a second transducer for emitting the amplified representation of the audio signal to a pair of earbuds coupled to ears of the user and removably coupled to at least a portion of the frame, wherein the earbuds are configured to block environmental noise from reaching the ears of the user.
 2. The hearing system as in claim 1, wherein the earbuds are made of soft rubber that creates a seal with each respective ear to block environmental noise from reaching the ears of the user.
 3. The hearing system as in claim 1, wherein the earbuds include passive noise-canceling padding and high-density foam to block environmental noise from reaching the ears of the user.
 4. The hearing system as in claim 1, wherein the earbuds include active noise-canceling to mask low-frequency sound waves of ambient noise to cancel unwanted sound.
 5. The hearing system as in claim 1, wherein adjusting the audio signal comprises adjusting amplitude of at least one audio parameter of the audio signal detected by the converter to be at a damaging level.
 6. The hearing system as in claim 5, wherein the at least one audio parameter of the audio signal includes volume, frequency, and pitch.
 7. The hearing system as in claim 5, wherein adjusting amplitude of the at least one audio parameter to a preferred non-damaging audio level selected by the user using an electronic interface to tune and equalize sound playback.
 8. The hearing system as in claim 7, wherein the adjusted amplitude is stored as a preset, the user selecting the preset to set the adjusted amplitude when in an environment with damaging noise. 9.-56. (canceled)
 57. The hearing system as in claim 1, wherein the frame is configured with at least one sensor for measuring at least one of physiological functions of the user and physical surroundings of the user.
 58. The hearing system as in claim 57, wherein the at least one sensor includes at least one of a temple area sensor for measuring the physiological functions and a capacitive touch sensitive area that the user touches with a body part for measuring the physiological functions.
 59. The hearing system as in claim 57, wherein the at least one sensor measures the at least one of physiological functions and physical surrounds by use of at least one of electronic signals, sound pulses, light pulses, x-rays, odor detectors, accelerometer, and radiation.
 60. The hearing system as in claim 1, wherein the converter is further configured to pitch shift the audio signal such that the user at least one of detects and hears sounds outside the detectable frequency range of human hearing.
 61. The hearing system as in claim 1, further comprising an accelerometer coupled to the convert to reduce vibration noise detected by the hearing system to enhance the clarify of the audio signal.
 62. The hearing system as in claim 1, further comprising a transceiver coupled to one or more computer processors embedded in the frame, the transceiver configured to connect with communication devices, and together with the one or more processors, further configured to function as a mobile computing device.
 63. A method of protecting from damaging noise, the method comprising: processing an audio signal by a first transducer coupled to a frame configured to be worn on the head of a user, the first transducer further coupled to at least two microphones situated on the frame and configured to receive the audio signal; converting and amplifying the audio signal to an amplified representation of the audio signal by a converter, wherein the converting adjusts the audio signal to an audio level non-damaging to hearing functions of the user; and emitting the amplified representation of the audio signal, using a second transducer, to a pair of earbuds coupled to ears of the user and removably coupled to at least a portion of the frame, wherein the earbuds are configured to block environmental noise from reaching the ears of the user.
 64. The method of claim 63, wherein the earbuds are made of soft rubber that creates a seal with each respective ear to block environmental noise from reaching the ears of the user.
 65. The method of claim 63, wherein the earbuds include passive noise-canceling padding and high-density foam to block environmental noise from reaching the ears of the user.
 66. The method of claim 63, wherein the earbuds include active noise-canceling to mask low-frequency sound waves of ambient noise to cancel unwanted sound.
 67. The method of claim 63, wherein adjusting the audio signal comprises adjusting amplitude of at least one audio parameter of the audio signal detected by the converter to be at a damaging level.
 68. The method of claim 67, wherein the at least one audio parameter of the audio signal includes volume, frequency, and pitch.
 69. The method of claim 67, wherein adjusting amplitude of the at least one audio parameter to a preferred non-damaging audio level selected by the user using an electronic interface to tune and equalize sound playback.
 70. The method of claim 67, wherein the adjusted amplitude is stored as a preset, the user selecting the preset to set the adjusted amplitude when in an environment with damaging noise.
 71. The method of claim 63, wherein the frame is configured with at least one sensor for measuring at least one of physiological functions of the user and physical surroundings of the user.
 72. The method of claim 71, wherein the at least one sensor includes at least one of a temple area sensor for measuring the physiological functions and a capacitive touch sensitive area that the user touches with a body part for measuring the physiological functions.
 73. The method of claim 71, wherein the at least one sensor measures the at least one of physiological functions and physical surrounds by use of at least one of electronic signals, sound pulses, light pulses, x-rays, odor detectors, accelerometer, and radiation.
 74. The method of claim 63, further comprising pitch shifting the audio signal such that the user at least one of detects and hears sounds outside the detectable frequency range of human hearing.
 75. The method of claim 63, further comprising reducing vibration noise detected by the an accelerometer coupled to the convert, wherein the reducing of the vibration noise enhances the clarify of the audio signal.
 76. The method of claim 63, further comprising, connecting with communication devices using a transceiver coupled to one or more computer processors embedded in the frame, and together with the one or more processors, functioning as a mobile computing device. 